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I. INTRODUCTION 


The Armed Forces in many countries have been ardent 


MES of the psychological techniques of selection and 


Blassification. The Forces! involvement witn these preced- 
uzes khas been fer such a considerable period of time that, 


in fact, it could be argued that the development and rafins- 


ment cf these techniques has been greatly enhanced by che 
Manpcwer demands of the military. In war, and in preparation 
mas (i.e. mobilization), <=he military -squired techni- 
ques which allowed the assesssment of the training cavakili- 


i a 
bres Of prospectiva civilians for their rapid rransition 
won civilian to uniformed status. It was ineffic 

have every potential enlistee embark oz 
when psychomezric tests could be use 
ds viduals w<h the lowest chances of 


u S 
Second Werld War, the peace time forcas, largely throu 


C 

gr the 
develcpzent of more complex weapons systems, have come zo 
demand much more specialized manpower skills. TIE TO CES! 
requirement for selection and classification, therse£cze, has 


mee cnly involved making military 0390 out 


O 

iS. s=alection), but also dealt with the cotrect placement 
Seeenlistees by military occupation (i.e. class 

Beem the size and the diversity of che Arn 

manpower requirements have make it a very ferti 

maung fcr the application of these psvcholcgic 


usos. 


The present thesis is concerned with the zefinement of 
a 


election stancards for x hree smploymen- Categories 
(ratings) in the United States Navy. The thrs= ratings nave 
been chosen on the tasis of the complexity of che tasks in 


ene ratings. In “increasing ordez of complexizy they are: 


11 





Ship's Serviceman, Personnelman and Aviation Technician. Ail 
three ratings have currently applied test score entry stand- 
ards based on th2 Armed Services Vocational Aptitude Battery 
MSVAB). The aim is to examine tna possibility cf imprcving 


me selecticn criseria fcr each rating, taking into account 


iD 


eming specific utilities of correct and incorrect selection 
decisions. At the same time, the selection s*tandards aczcss 
jobs will be compared. Such an inter-job analysis will 
mDLustrate rne relaticnship, if any, that jcb complsxi-y has 
ith the selection standards. This latter analysis will be 
mualitative (wha- kinds of predictors ars mere suited to 
usc. type ot job) and quantitative (how does 
accuracy cf seleccion vary with jcb complexity). 
Ssiection standards research for the US Navv is 
Ewcrtant fcr a large number of reasons. Prem the point of 
view cf manpower planning, better selection sta 
mean smaller training attrition, better job oe 
longer careers and acre rapid promotion. These ou 
the effect of lifting the burden of maintaining 
end strength frcm new enlistments bv having greater numbers 
in the career force. This has sven more Significance wit 
the projected decline in the services! traditicnal manrower 
rool over the next decade, Pact woeuectiy In “mes.” when 
Manecwer rescurces are scarcer, the disutility cf rejecting 
potentially successful applicants is much greater than it is 
Bene current recrtiting clinate. E 34 "DEDO det Coma] ke, 
ENET ent government regulation explicitly forbid 
ractices which may have adverse 


Sener groups in the community (Uniform Guidelines on 
e 


Employee Selecticn Prccedures, 1978) without first investi- 
Secinge=ne use of "alternative selection procedures that are 
equally valid, but that produce less adverse impact" (Reilly 
Bwa Chac, 1982). It is encumbent upon all employers, 
wel uding the US Navy, first =c determine the validity of 


2 





Hes current procedures and then to examine the possibility 
of using alternative methods which may either impro 
these standards or are equally valid standards which na 
less adverse impact. 7-70 ٣۲ ۹6ہ‎ a Second aw DEC 
E crfj3ated incentive for an Craganization to be interested i 
and te be akle te measure the validity cf, lts own selec 
procedures 

There is a wealth of research on selection standards 
both in the US Navy and in many other emo 


Eun the aim of locking at selection, in relazicn ro the 


suplexity cf the jcb and the validity of the procedures, 
the nex- chapter 1s devoted to literature surveys. The 
Best section dealsarvztpeetne. t€haore=ical aSpec-s of 
selecticn research, while the second is a review of thea 


findings cf previous ressarch regarding thos? factors which 
seem most predictive cf job success, in general, and for the 
services in particular. 

Mee *hird chapter brings the inf 


one tegether so as tc make a clear statement cf the purross, 


O 
l1 
H 
m 
ct 
ps 
0 
j 
O 
îh 
(d 
0 
(D 
"U 
ti 
iD 
< 
pa 
O 
t2 
Uu 


aim, design and expected outcome of ri 


h 
Chapter four deals with the method. Firs*, the subject 
Menos are desczibed. This includes a desczipc-.on cf sach 
maang, the standards currently applied and sn examination 
EE ^c reths 2hrough which individuals enter the ratings. 
ext 


Me will include the complexity grading cf each rating. N 
mes a cescription of the data base for this ze 
where it ccres from, what is included and an assessn 


A quality of tka data. In the rex: seccion, the rerzscnnei 


0 


ace described. This is followed by a section which cencerns 
the critericn measures and predictors: What are they?, and, 
How they are measured? Another section describes the esti- 


frees Of" the utility of correct predictions and the disutii- 
> 


ities associated zh misclassifications. Next, the 
cross-validation procedures used for the estimaticn of «he 
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NN Icy coefficient area described, poop MINE Eta. se 
tical techniques are discussed. 
Chapter five Concerns results. Pae Tirs: 
E 


with descriptive statistics ہ0ۃ‎ each of 


which includes age distributions, racial ant sex  mixss as 
well as prior education levels. fhe exc secco on Conceras 
the results from using regression techniques. The final 
section resents results in which the کی2‎ 7 S OF 
selecticn cut-offs are examined with respect to maximising 
total expected return for the selected procedure. 

Ghaprer Six is ior the discussion of the results. lè is 


S 
divided intc two sections: expected outcomes and other find- 
igs.  Perticular attsntion is paid to across Ta g 
isons. 

Chapter seven prcvides a summary and a statement of the 


conclusicns and recommendatiors. 





Li. DITEBATURE REVTEN 


The purpose of this chapter is to review some of the 
literature relevant to selection standards research. T 
€ 


firs- secticn deals with a general overview of th 
E 


p 

S 
it apply? What types cf experimental design are pcssibls and 
Bnpropriate in this type of research? Then, in more detail 
specific thecretical issues are addressed. Thes2 aze job 
Bwalysis, criterion selecticn, predictor selection, valida- 
mon and cross validation. The second section reviews 
research conducted specifically in selection ant/or attri- 
tion. These questions are addressed: What variables have 
been fcund to be predictive of success in the werk environ- 

abl 


nent? Spec -1ıcally, what varl 


elecess in a service environment? And finaliy, what taccer 
predict success in a Navy environment? The final section 
provides a summary cf “he theory of, end the previcus 


Besearch in, selection. 


A. THEORETICAL LITERATURE 


1. Classical Mods 


- 
ccom-p بے جح‎ va — 


A classical acdel for establishing selection s*and- 
ards is suggested by Drenth (1971). Like mcs: classical 
approaches it is protabl never rigidly applied, however 


Drenth's suagestion gives a good des 
Emvolved and is a useful starting poi 


These steps are summarised in Table I. 
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TABLE I 
Classical Model of Selection 


Job Analys 
Choice of a cu ¿On 
Iry rout SEE s of Tests 
EE تک‎ Experimental Group 
Validaé noe of Tasts 
Cross Val: saat lon 
Tests in Final Forn 


UU UN UN UN UN UN 
€t ct 6 ct chat ct 
(b :f 0 «D 0D (D 0 
ن:+ ق۶ ن۴‎ ٢۱ل‎ ۱٣7٢٥ 
AOAN E WUN — 


NETE Drenth,P "Theozy and Metacds 
0£ SeleCction"t, 1971 


Moro AAN, 


ur yr y 


The first task is a job analysis in 
psychological requirements of the job can be 
this step lt is necessary tc convert the descripti 
job specific factors or variables which a 


© 
criterion which is the operational means of 


nese 
and, hopefully, are measurable. The second task is t 
mine the 

n 


measuring an employee's job performance.  À knowledge of the 
criterion value should Bali a a ready differentiaticn ٥ 
good rezfcrmers from the poorer ones. Ideally, i* will be a 


Ic o- ordinal scale which will indicate -anges or grades 


- 


cf performance. In the “hird step, the jcb analysis is used 
to mak= an 'educated' guess as to what kinds of tests or 
Baer factcrs are important for predicting success in the 
job for which the standards are designed. The preceding 
steps are necessary precursors to the next group which deal 

p 


WL the empirical pcrtion cf the process. The fourth ste 
En"s:sts or the “ry-cut (or pilot) tests which are adn 
tered te a representative sample of the pepulaticn f 


= 


O 
the standards are tc be developed. Scores or results are 
recorded and retained while the employees are given a O 
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Decime tc perform on-the-job. In step five, th 
are measured on the performance criteria develo 
Ewo, and the results are correlated with the “rest eccres 
Bathered in the previcus step. From this analysis the merit 
Se cach test is determined leading to the a choice o 
D 0 usetui for selection and their appropriate cut ci: 
EsSres. Step six is critical: enc Toss Val da ion. lez the 
selzction standards fcr new group of subjects. In this step 
the same procedure as applied in steps three to ziv S 
repeated using the chosen selection tests. Step seven is 
largely administrative. The selecticn tests are set up 
standard form. For small organisations this st¢p may net be 
essential, but for lar 
ers 1S highly desirable, especially where «here may be 
several difrerent testing stations. 

The Drenth classical model is az ver 
scheme of the procedure for establishing selection stand- 
Brds. For one thing, it appears to assume 'tha- the crganiza- 
tion has no selection procedures in existence, simply 
EN wing individuals to drift inte occupations. While it may 
not be strictly formalised, the organization probablv has a 
Men notron CE what is required in tne job ard applies -his 
information as a screening device. Despite these limita- 


“Ions, «ke medel alludes to so 


3 


a vary important issues which 


are discussed in the subsequent paragraphs. 


2. Validity aad Research Design 


very important iss he simple 


E 
case above, it is scribed as sone ne omparing the 


a 
de a € 
selecticn test results with subsequent performance in order 
n Standards. Validity answers the guss- 
tion: dc these test scores tell us a sufficient amount about 
the individuals! subssqusnt perfozmance so that, based only 
kn 


on a cwledge of their selection test results, one is abie 
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meme chcose the  be-ter perfcrnmers. Svaceceacatiy, 2c s 
usually repesented ty a correlation -coefficient which 
expresses the degree of association betwsen the selection 
test scores end the measure of subsequent performance. 

Two main types of research designs have been defined 
with respect to selection validation. These are predictive 
Bad Gcncurrent validity (see Tiffin and McCormack, 1970). 
Predictive validity is that implied in the model above 
selection tests ar: given to a group of applicants and then 
at scae later date, criterion méasures o= rerformancz are 
made. Tte test sccres and criterion measures are then 
compared. For concurrent validity design, the tests score 
and critericn measures are 3 
time. Por both types, the test 
are ccnsidered valid, if co tions ars large =nough. 
Beil recently, the pre 


3 2. 


a 
e validity design was censid- 
1 


(0 


sed far superior than concu xgs-y-apprcachn (Dienen, 
1971). Hcwever Barrett e+ al (1981) persuasively argue that 
Bs evidence does not support this position. They sugges- 
that a large number of independent studies, inciudir 2 
recent meta analysis cf 537 separate suudies, have indicated 
Virtually no difference between the magnitude of the validi- 
ties found fcr concurrent and predictive designs. They also 
eat one reseazcaer who specifically ccmpared tha two 
designs in a national valida-ion of selection procedures for 
Meme t-apnsit bus drivers and found that the validity 
ہ٥‎ ۶116-5 WET comparable. These arguments are 
pognvinczng but what are the significant differences between 
the two validation designs? 

Guicn and Cranny (1982) suggest that +he key differ- 
ence is that for predictive designs there is a lapse of time 
Fetween test and critericn measurement whereas in concurren: 
designs the measurements are m2de simultaneously. Howevsr 


there is a second fundamental difference between the two: 
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Beediccive designs invaziakly test groups cf applicants, 
rather than employees, as tested in concurrent desi 
There are some problems for concurrent designs in rela 
to the restriction of range of tests scores. The enplo 
who are the subject cf concurrent designs have been p 
Mected contributing tc a narrowing of the range of data. As 
is noted by Hammer and Landau (1981, p. 576), range restric- 
tion shrirks the feasible range of the correlation coeffic- 
ient; «that is, its feasible maximum value becomes less than 
one. Predictive designs are not completely free frcm corre- 
laticn prcblems, since there is a time iffererce between 
tests and criteria. Scores on the latter may well be dus tc 
Mletcrs cther than "those implied by the tests sccres. 
Mucervening variables (e.g. training factors, motivational 
changes) could also Dnhsps cw crscer:on 787-۶27۲13-566 
Baditicnallyv, elo Ch nay reducs tho size of the group so 
that there are fewer individuals available for 


measurement than 


x 
D 
H 


E 
e crginiallv t=zsted. It can be seen that 
D 


Beh concurren: ar 


= 


d predictive designs are susce 
shrinkage cf validity cosfficients. 
While it seems only logical f 


F^ 


Baecticularly a large ons, to have val: 
ures, government regulation has a siqnific 
these  przcceduzes requiring employers to hk 
systems which have been tested through a general validity 
model. Hsu (1982) jeu our that the Uniform Guidlines on 
Employs2 Selection Prccedures (1978) specify "that a neces- 
EE Y condition fcr use of a selection procedure, when -hat 
procedure preduces adverse impacts on the hiring rates of 
certain minority groups, is that this procedure be demnons- 
Ep ced valid" (Hsu 1982, p. 509), buc that this is no 
BwEficient condition for its use. Hsu explains th 
organisaticn to use any existing selection pr 


produces edverse mincricy impacts, it must have 
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validity than alternatives which have no adverse inpac“s. 


Many civil actions have been won during the last decade by 


employees (see Rcwland et al, 1980, pp 64-85) against 
employers who have had selecticn syste for which the 


validity has been unknown or inadequately established. So 


there is a considerable amount of external pressure for the 


Megenization to, first, know what the validity of its 
Brocedure is, and to, second, establish, in ths case that 
there aze adverse impacts, that there is no alternative 


system which is equally vaiid that will prcduce a less 
adverse impact. 

Given this general overview of the technical litera- 
ture, it is now possible to deal in more detail with cther 


issues 


3. Jeb Analysis 


It is probally a fairly safe ass 
few attempts at intreducing selection stan 
thorough job analysis (such as is descri 
mo, Chapter 15). This is so for a variet 


meme least of which is that it is very time consu 
a 


ct 
7 


requires a considerable amount of effort wi 
ale by way of quickiy identifiable return f 
Mábouis. A job analysis is not part of this research, fut 
Chapter IV includes a brief job description of the three 
Nay ratings invclved, in crder to put them in 

Pate context. Presumably thorough job analyses have been 
done for these ratings and used for the developna 


selecticn procedures. 


4. Ci erion ےر ےہ‎ on 


Dunnette's beok ("The Handbook of Industrial and 
Crganizaticrai Psychclogy", 1976) has two excellent chapters 


En he selection of an appropriate criterion, which T th 


M 
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Second step in Table I. This is perhaps the hardest step of 
all and has been one cf the "key problems in industrial and 
organizational psychology, as evidenced by the massive 
Eurorts designed to clarity its theory and improve its 
Measurement " (Smith, 1976, p. 745). Smith specifies three 


requirements of a criterion of performancs: 


EE shat vit be relevant of some organizaticnal or 


indiv dal oa ebucsmercher biased ror trivial; 


b. that it be reliable and “involves agreement between 
đifferent evaluations, at different periods of tine 
and with different although apparsntly similar 


measures" (Smith, p. 746); 


ELEC that 3st be practical: that is, available, 


ct 3 
j 
ID 
(3 


tt 


-itle and acceptable to those who will use i 


t4 


decisicns. 


Another issue that has received much research is 


(D 
pa 


the choice between a single performance criterion and 
mu. = 


Eai plese criteria. In the classical model, tke em 


Ó 


p 
n a Single criterion which met all the requirements 
uencsoned above (Guicn, 1976, p. 783), but the weight of 
lEut crini icon is towards multiple criteria (Smith, 1976, p. 
MENEN TISE Firstrargumer- in favour ot the .01۰ھ‎ 8 ٤ 
Solution iS on logical grounds: the various possible 
criteria are all different ways of measuring the same 
unitary concept and using mora than one measure gives a 
tetter estimate cf this concept's true value. ت۲۰‎ 56318702 
that two individuals with equivalent “total perfcrmances 
could achieve these results through quite different behav- 


iour patterns. The cther arquement for multiple criteria is 
V 


emprrsical: "an overwhelming majority of studies involving 
statistical analyses of sets of criterion measures finds 
that -hese analyses rareiy yield a single general 
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B3ccor...several Criterion measures are necessary to accoun- 
mont the variance in a Criterion correlation matrix" (Smith, 
n6) p. 748). The choice cf criteria and how to combine 
them are difficult prccesses and must all too often be based 
On cenvenience rather than their relevance to long term 
effectiveness. 

Several recent studies have proposed the use of 
utility concepts in performance measurement which could be 


used as a criterion {landy, Farr and Jacobs, 1982; Schmidt 


Bud Hunter, 1981). Vota (cones pes sygciludeo such tripas as 
the number cf successful employees hired, increases in the 


مھ 


è 
b 


average level of performance, and zhs amount of savinacs 


dollars and cents, as a means of svaluacing the sffsc-s 


O O 
Fh Fh 


various selection strategies. Most recent applications 
ga lisy concepts deal with the value žo the crganisation of 
the hire individual which was derived by es-ima-in the 
average value and the standard deviation cf performance 
expressed in dollars. These criteria as they stand are 
inappropriate for the present study, but the application 
utility analysis is discussed below in relation 
determinaticn of optimum cutting scores on predictors. 

In adaır'en, Smith (1976) suggests sever 

V 


variables which have been found useful as pro 


and "soft" criterion measures. Under the hard catagory are 
tardiness, absences, accidents, tenure or turncver, sales, 
production, job level and promotions. Even these may contain 


Some soft elements largely due to the effects cf human 
judgements. The soft criteria are thoss which involve “he 
use of rating scales, usually completed by supervisors. 
There are a large number of sources of rating scale ¢rrorz, 
and" an even larger number of methods +0 minimise their 
effects (see Landy and Farr, 1979: Salon, 1976, ER 
757-764), but these will not be considered in de-ail here. 
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Toet y NaO Seet ests which may serve as 
qss Criteria 


Berors, Guicn (1976) sug< 


o een Dehari úr (1.6. the Criterion) cannot bs fuil 


«X 


predicted ty simple means, thus a 


(A 
H 
"m 
ua 
fe 
D 
٢ن‎ 
۲ 
D 
Cu 
EJ 
0 
ct 
O 
tt 
ps 
tn 


usually inapprcrriate; 


b. complex performance is a function cf he individual, 
DIEMEN IH Cobra nN eX eat, thereiecre fn thanking cf 
PRECHE FOT ES ٣٣۹٦٦ ent to go beyond individual 

traits and include si onal and demographic varia- 


2 { 
bles as sources of votential predictors; and 


ee complex behavior is not likely to be optima 
icted in precisely the same way for ali people, while 


Peel Sw nctsreastibple te have prediction equations for 
O 


each individual, it may be possible to develop 
different equations fcr logically different subgrcups. 
He alse suggests many publications to consult Suga 


Ghiselli, 1966) which provide a summary of predictive valid- 
Eos for various jok categeries, DV EBE co. 7 1-7 
by type cf criterion. They are, he suggests, a good starting 


Point. 
Ecc Val:daticr 


cas portant ne concepe or"val*ds-y -has been 


in 


= 


ct 
LI. 
iD 


c 
= 


described as a correlation coefficient which expres 


relationship between predictor and Cri terion m 


Mn 
C 


d 
{N 


a 


M 


However, this concept can be extended. As no-ed by Campbell 
Mp6}, the correlation ccefficien: approach to validity 


ENDIICs: 


EO" there is One normally distributed criterion or 


1 66800051 "۰2۶16ء2 
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“here is ane nernall istributed predictor cr rred-‏ ےک ×ط 
p Į‏ 


ictcr composite; (and) 
ےت‎ the relationship between them is linear and homcsce- 
3-3 E 7205) 


The stringent conditions and are often violated. He 


Aether challenges ttie practical use of a validity coeftic- 
mc. 


0 
(D 
p 
ri 
(D 


hew are decision makers to us2 say, the value of .55, 
ENEdetermining which ofa group of applicants shoui € 
selected? The ccefficient says little abouz how to produce 
the desired outcome. Provided the above three cenditions 
eee met, the validity coefficient is useful for determining 
mel Of a group cf predictors is more appropriate For 
selection kut Campbell describes what he calls "decision 


centered" validi-y as a more useful approach. 


pou 
77 


With a decision orientation, Selection research 


viewed an attempt to predict ۹15۶ cutcomes ca 


(+ 
0 fu 


ent erion which is categorical in nature. The catsgoris 
be predicted are made up of those who succeed a 
wO fail. The task for the predictor then is to establish a 
Ting" score which maximises ths proportion cf correct 
predictions. BUE ANE WO SWE ٣۲6٥٥ جج 6627266-612-6002 562776707762 76 چ‎ 
ions to te defined? In the equations belcw, the tE 

By TT ENG Dall refer tor, the numbers of perse 
Peredrerory cIiterion cutcome. A is the number who are pre 
Ed to pass the criterion and who do, in fact, pass. B is 
the number who are correctly DBredieree to fall ume 
critericn. C is the number who are predicted +0 pass but who 
subsequently fail the criterion. Finally, D is the number 
Who are predicted to fail but who would have passed. Using 
these figures, two examples cf how the proportion of correct 
classificaticns may kte defined are as follows. One method, 
Emation 2.1, is tc take the proportion of correct class- 


yon 
+ 


(b 


Bricatiens cover the total number to classify. Ancth 
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Hpprcach, Egwmation 2.2, takes as the statistic the number of 
successes cver the total number who pass. There could be 
e her possible definitions. However for both equations, the 
Alea is to select e "cutting" score on tha predictor waich 
Maximizes the value cf the expression. What is forgotten in 


beth these definitions is that sach embodies a values judae- 


ment in the way the statistic is defined. Equation 2.1 
CP = (A + EJ/(A + E + C * D) (eqn 2.1) 
CP = (A)/(A + C) (eqn 2.2) 


applies an equal weight <o both correct predicti 
wo 


and does not distinguish between the - EY Pp 

(categories C and D in the equations) si carns OS MINET 

(negative) value to the organisation. Dauer lon 2:2 201925 

completely the outcomes for individuals who arə nor in the 
n u 


predicted success grcup, in effect assigning a val 


€© Sach of these cutcomes. The question arises then as t 


(b 
rh 
O 
Hi 
ci 
a 
(D 
th 
O 
ar 
14 


what values should be assigned to each cutcon 
possibilities, aiven in the equations, “¿o derive an appro- 


Mena we cutting score? 


Fh 


Phe answer Lies in the appiilcation of che concer- o 


(Û 
rt3 


utility which was referred to briefly above. às described by 


Campbeli (1976), utilities are estimated for each cutccme in 


Maita tions 2.1 and 2.2. ۶02 23001:1627 ۶۲۰۰" ٣١٣ 08 
discussion, tke terms pass and fail efes to ٭ .اع‎ 7 
results whereas positive and negative refer to vredictor 
score resul-s. Thus, outcome À is a pass/positive outcome: 


these members are correctly preadic:ied to pass cn the 
criterion. An exampie of the application of 


ü 
how they are maximised by varying the cutting secre is given 
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TABLE II 
Tctal Expected Utility for a Predictor Cut-off Value 


Id felarivé utzlities for each outcome 


Success -5 0 | 


Failure | 10 | - 30 { 
SS ee So onn 

Predict Predict 

Failure Success 


Eee LOoabl 1 dee Of ' sach outcome fOr a certain cut-off 





O E c ps سیت جو تا‎ Beeren 
Success . 16 | 220 . 40 
Failure . 48 2ء‎ | .60 

972 Predic- 

Failure Success 


ies and probabilities 


D 


MM -rcuqdvcto osPbuti 


Success mM 5:5 | EX | 





Tegel =xpected Meriliy for--his cut-off = 2.80 


n A A ain aaa agih c a IA Rename P کے‎ 


, 5900 E a | 
Failure 4.8 -3.6 | | 
—- | — o | 

Predict 29 2 ٦ | 

Pailure Success | 

| 

{ 


| 
k 
| 


| 
| 
| 
| 
| 
| 
| 





an Table II (this example is very similar to that given by 
EEUDell, 1976, p. 212). As can be seen from Tabla II, part 
A, the pass/positive outcome is given a value of 10 

utility which is the same value as the fail/nega 
COS. This impliss that it is as valuabls to the crg 


Saticn te predict a success as it is zo correct 


that each outcone is 


fu 


y 
n rure. The negative signs in the other two cells sug 
dummer cy c. che. org 
4 


Further, it is clear tha: the relative values in 


Exdo cats that the disutility of incorrectly  ider*tifying a 
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failure, Bcc emxLHaDOcincortmrectiy Identifying an 
individual who would have been successful. In fact che 
Beemer disutility is six imes as great and it is not diffi- 
cult to see why this would be so. Allowing a future failing 
individual in to the organisation is much more expensive 
because cf the larger amount of investment which is lost 
(e.g. training expenses, salary) compared with the rela- 
tively small investment lest on the rejected a 
would have been a success. The question remain V 
to hew tc use these utilities in the deriving selectio 
mu ofS. 

To see how the utility values are used foz deter- 
mining the effectiveness of a selection procedure, mrs 


Ecossary tc examine all three parts of Table II. 


shows the proportion of the sample residing in ea 
based upcn a cut-off score on the predictor. It forecasts 
that 38% of the applicants will be successful. TES Ig 


these cell entries as a probability of belonging to that 
Sell, it is now possible to calculate the expected utility 
Fam each cell by multiplying the probability by the corzes- 
Emu ng utility. The result is shown in part C of the table. 
Hoa cutting point cf 38% predicted successes, the total 
expected utility is simply the sum of each of these cells: 
Woe is che expected utility for this particular cut 


a 
Score. Using this same procedure the next possible cut-off 


i3 


score on the predictcr can be evaluated. (egre 
mie -OLff will most protabiy produce different proporticns of 
cases in each cell, which will in turn change the value of 
ئ٠‎ otal expscted utility. Continuing «his process for all 
possible cut-offs produces a total expec-ed u-ili-ty for each 


Euc-off level. The cut-off which should be -choser is the 
cne that maximises the expected utility. 5۰-600 3 ٣ 


cut-off levels result in negative expected total utility, 
then the selection device is of no usa to the organisation 


and it shculd not be used. 
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hin hə USBNavy setting; it is possible to make 
estimaticns cf the various utilities associated with each of 
mie four possible predictor/criterion curcomes through ccst 
E UUrrcductivity analyses by rating. Utilities for three of 
the four possible outcomes appear to bə relatively straight- 
forward, prcvided scme simplifying assunptions are made. 
These three (associated with A, B anā C in the equations) 
may ke estimated frcm the Billet Cost Model (Assessment 
Eur, 1983). However, the disutility of :he czhsr cell, 
nisclassified pass (D in the equations) is more difficult. 
For the defense force the disutility of this outcome is verv 
men a function of the recruiting market. Dur-a2g lean 
mecruiting times, when quotas are hard to fill, to reject a 
potentialiv successful candidate has greater disutiltiy than 
would in the current recruiting climate. The utilities 
associated with the cther three cells should bs impervious 
Euch fluctuations. The actual derivaticn of utilities is 


discussed in the Methcd chapter. 
ME Cross Validation 


Depending on the statistical tachnique employed, the 
results cf selection standards research will be effected by 
@entain characteristics specific to the sample used in the 
day (Weiss, 1976, p. 332). This means that the results 
Will reflect not only the true relationships between the 
Meeeecticr end predictor variables, but they w a 
polecc relationships which are unique to that particular 
Sample, and this uniqueness may not be gensralis E 
۴۰9118-2۰. To avoid these problems selectio 
usually cross-vaiidated. 

It is not necessary to cross-validate in the sa 
manner which was described for the classical selec 
model. This would involve the complete replication of the 

C 


original reséarch on a néw group of subjects. More effi 
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End less costly methods are available. Campbeti (1975, n. 
214) describes what he calls she ‘double cross-validaticn! 
design. Here the sample is randomly split into two equail7 
sized subsamples. The statistical techniques are apclied 
independently to each subsample to derive the decision rules 
for the final version of the selection devices. The decision 
rules for subsample 1 are applied to subsampl2 2 and the 
validity estimated. The decision rules for subsample 2 are 
applied tc subsample I and another coefficient is calcu- 
lated. Ihe average of these two coefficients gives the 
Maliai“y for the procsdurss. Ideally, OE Course, Aths daci- 
sion rules for each subsample will be essentially the san 
Marked deviation between subsamples indicates that either 
cne cr bcth results are sample specific and therefcre th 
would bs suspect. 


The double  cross-vaiidation design could apply 
ually weil to the utility method for estimatin she 
optimal cut-cff values. Cuc-offs could be determined on 


Bredictcrs for one group and then compared with the cutcffs 


derived fror these same predictors on the other subsanpl=:. 


Pee RESULIS FROM PREVIOUS RESEARCH 


As was indicated earlier, these is a great deal of 
research literature cn perscnnel sel 
MONS. Tric includes studis fer alecs: eyery eoyeeivyeeb 
emplcyment type both across the community and, within and 
SS the services. The purpose of this sec تا‎ 
“Eficient cf the previous research so a f 
Beamulating research hypotheses in the next ch 
E her intended nor claimed that what follo 
earc 


inclusive review of personnel selection res 





1. General Results 


The history of mental testing is intertwined with 
+h 


milat CL personnel selection in organisations. During 


N 


1950's and 1960's, Many organisations adopted “he IQ asa 
standard measurement for use in selection and placement in 
virtually any employment setting. But the whole area of 
human ability testing, anelndıng ERE concep of 10,1 cams 
NI der fire in the late 1960's, The civil tights movement 
Mad a ict te do with this, as articles and monographs (e.g. 
Memsen, 1973) indicated that there were significant mincrity 


scores differences on these tests. PUE ner, “thers. w 


0 


(D 


pou 
de 


ct 


clairs that minority groups wer2 disadvantaged, thrcugh +<s 


a 
3 


bias, by organisations which employed psychological tests 


J 
As 


Mist s=lecuion procedures. In a recent article Carroll ar 
Horn (1981) sought +c make a distinction between «he science 
and the application of human ability measurement. They 
claimed that the science of human abilities was ina "hase 
of confusion (as evidenced) when ideas about human ab 

re regarded as equivalent to ideas about 190 measurement 
EEUU chat valid criticism of particular applications 
Measurements are rot, in general, criticisms of the sc 
of ability measurement" (page 103). They argue that “here 
is no particular faul* wirh the scientific aspects of human 
۰ئ‎ ۰ measurement, ciaiming that 80% of the variance of 


Aa ty differences is accountable in test | 


£z 


easurenent, and 
suggesting that the application of these Tests has caused 
mee difficulty. 

Schmidt and Hunter (1981) also discuss this issue, 
but in a more applied sense. They have derived, cver the 
last five years or sc, a procedure for evaluating che 
ficance cf individual validity studies, in which they 
is scmetimes difficult to detect the presence orf ef: 


sampling bias, Specifically, they dizectiv address many 


30 


the criticisms cf mental testing put forward in the last 
decade. These include the notions of low utility (ssiec-ion 
procedures have little direct bearing on organisational 
productivity), test unfairness (sel=ction procedures are 
biassed against minorities) and test invalidity (selection 
test validities may be situation or job —— and not 
truely general). Numerous recent studies are referenced in 
Support cf the idea that selection procedures do not have 
8۳۰.۱1٢1۴7 ۔‎ This leads to the conclusion that the potential 
effects of employment testing on productivity have ben 
underestimated. The authors deal with test unfairness by 
suggesting that the factors causing low test sco 
Beodauce  rocrer job performance, for both majority and 
Minority groups. They conclude that employment tests d 
cause adverse impacts against minorities and they seem to 
support Jensen (1980), who demonstrated that when minorities 
are selected on procedures developed on white  samries -he 
Minority group is favoured (see Jensen, 1980, p. 515). The 
mama issue cf test invalidity is similarly azqued with che 
presentation of many studies which support the notion that 
tests are valid for employment prediction. One relevant 
zudy shcwed that when jobs were grouped acccrdina "to 
Semolexity of intormation-processing requirements, the 
.۹ئ‎ cf a coupcsite of verbal and quantitative abiii- 
ties for predicting on-the-job performance varied frca .5 
Meme the highest level job to .23 for the lowest" (page 
1133). This hs lan —nverpesting. finding considering ché 
emphasis in this thesis on selection for various complexity 
levels. Peecugdestc cans €. that cognitiva ability should 
Wala for predictirg job performance and, second, that 
moe Validity should increase with job complexity. Smith and 
Hunter reach three ccnclusions: 


a. professionally develcped ability -təstSs -arə 6 
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292-70٣٦۰3 ٣ت‎ ٣ہے7‎ ۶٥ 7316066 beh on--he-jJob ahd in 


sala ges all TODOS: 


AAN UN ests are fair to minority groups as they do 
Meee uplerescrmete the expected Job performances of 


minorities; and 


C. ability tests used in selection can effect huge labour 


and cost savings in an organisation. 


EOL “ina MO SENI de and Hunter's. pap 
+ 


Miele a rental attack on the critics cf abili 
py and Chao (1982) <xamine tre validity and fairrsss of 


sone alternative selection P Qe ۸.۰۰ 0٦پ‎ 


government ragulaticn wher thers are adverse Minority 
effects. Cf the eight alternatives, LWO a3273 raelevant for 
the present study. These are bicgrahical date and academic 
performance measures. Biograph CaL daca "s what. “yré or 
Extorma:icn usually given by an applicaticn for a jcb, and 
includes such things as age, number of years schooling, 

marital status and number of dependents. These data have 


been successfully used IDEA Ted Eve cross-validated 
ENES, zeturning validities net as large as ter ability 
poss, but sufficiently closes to suggest they could be a 
feasible alternative. Academic performance measures, such 
as grade point averaces and course results, have net fared 
so well. Validities based cn performance criteria for these 
items have been sither insignificant or extremely low. They 


are nct reccmenäed as an alternativ 


ıD 


En®eumssschegretrere, 00:1. 1S Clear thas tental ability 
tests are relatively valid predictors cf job performance in 
Meet ualiy all settings, and that biographical data aze also 
useful and valid as predictors. Higher vaiidities heve been 
Bound for mcrs comeiex jobs when compared ‘with jobs cf low 


complexity. 
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BENG MI GENG tek Di ha Ijmeroduerion, the military 
has been a very fertile ground for research in, edd ice 
applicaticn of, selection standards technology. A 
studies cn the US military were recently rev 
Vineberg and Joyner (1982). These occured bstween 
1980 and were sslected because they were job pe e 
medic:icn studies. The authors! paper dealt with criterion 
and predictcr variables and the usual technical measure o 
els dity (i.e. the correlaticn coefficient) associat T 
different combinations of these variables. This extensive 
survey article is discussed in the next few paragra 

Vineberg and Joyner categorise the criteri 
bles used in military studies into three types: pro 
ED rerfcrmance and suitability. Proficiency variables are 
objective type measures of either job knowledge, +ask and/or 
task element performance. Job performance is expressed as 
either gicbal ratings, job element ratings (both of which 
are subject to the rating scal¢ errors referred to abcvsa), 
productivity (apriied cnly to Army recruicers) and the grade 
BE Skill level oktained. Dh cesussmbIITS y cr eria ara, nada 


a 
Bet SUCH things as length cr service, completion of 
2 


aq 


nlistmsnt term, misccnduct measures and recommend 
rs-enlistment. Within and across these 
best median validities obtained were for job knowledge 


(40), task performance (.31), suitability (. 24) and global 


tb 
£u 


Baeıng (.15) from a total of 350 validity cceffients. Based 
en these values, the authors concludes that the task perfor- 


mance and suitability validiiiss are high enough to sug 


ve) 
u) 
{N 
ch 


they would be useful in selecting nilitary personnel. 
Many diferent types cf predictors have been used as 
the independent variables in selection research. no ROSE 


Eecujer 2s aptitude {e€.g. mental tests), followed clesely by 


= - 
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biographic and demographic variables. In most ED RUS 
Studies at least one cther type of predictcr was used. Ags 
and education level (expressed as number of years schooling) 
were the most frequently used biographical variables. Ahern 
predicting suitability criteria, the variables age, mental 
ability and educaticn have consistently been found te be 
Significant. The median validities are: education (.36), 
mental ability (.24) and age (.21). When all three cf these 
variables are taken into account simultanecusly, then valid- 
ies have ranged from .24 to .39. Some evidence is 
presented which suggests “ha: when some early military 
experiences are taken inte account (s.g. ratings at recrui 
pining), chen the validities for prediction range from the 
-40s to the .60s. 


A 
ot 
qt 
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While the authors conclude 


t 


O D 
suggests the usefulness of these predictors +t forec 


۹ 


perfcrmances on these criteria, the maka two relevant 
O 


n 


points about the relaticnship of che variables and h 


b 
i" 
IN 


Maliditi ray be imprcved upon (page 22). PRE 88 Ame 
Beer one Made callie: din Thais paper: there are 


a 
ikely tc be many important differences within and acress 
an + 


Jobs, d these need to be taken into account when +¿h=o0:- 
Wing about what kinds of relationships exist. Jobs nay 
Aer in terms of job difficulty, the level of =ifecilre 


WI ing cf performance and how many of thes encumbents reach 
Enos level cf varfermance. These kinds of factors 2£ffecr 
what the critericn measure should pe and how it should be 
measured. The present study hopes to address specifically 
the issue of job complexity. 
Pic sSccenae Geint “io, thet “predictor and .criteérion 
EE cronshzips are not likely to be static over cine. Aich 
ẹxperience cn-the-jot, these predictors which were useful 
Boe prediccing “carly" criteria of performance te 


eur". It may be that as training and experien tend to 


zu 





the differences in technical proficiency smaller and 


= 
f» 
A 
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s*gnificant, then predictors are less able to 316 


to 
(Ð 
in 


S 
e between the perfcrmances. These points terá to empa- 


9 
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sise the notion that the expected relationships between 
Meeadictors and criteria might not be found in a sample, tut 
also that there are probably many alternative explanations 
Bee insignificant results. 


Studies of predicting military performance have been 


Gone in cther ccuntries with similar kinds cf results 

Some of the more Tecant ones are summarised by Johnson 
13932). An earlier paper, quite relevant to the present 
Esudy, was done by O'Gorman (1972). He studied regular 


u 
Eutrants tc the Australian Army and found that a total of 


ten pre-enlistment variables combined in linear multiple 
E 


regression were useful in predicting an effectiveness 
measure ci perf cr mance. Theme cer on consisted of 
Bssignina the value "1" to those who did not complete their 
service fcr reasons cther than death or illness, ETS 
those who completed thres years without promotion, and "3" 


to thcse whc completed three years and who wra promoted to 
Esspcral cr higher. ERE SIN pi Sante pred cs67. Veabieb les 
mWeltuded age, marital status, aptitude scores  (generai 
EU ÈY and clerical ability), zesul“s con a psychiatri 


ME ntOÒry, cCitth order and prior service. 


ci 


Mcre specifically for the current thesis, there has 
been scms recent piict research (Lurie 1981) aou cidem see 
mrad selection standards for “ke Ships Serviceman rating. 


In this study Lurie attempted to relate pre-entry variables 


to an improved criterion of Navy success: rather than the 
eievavability of ٤210122 during beir. Leste oa. he 
EMUSnrted tc employ a job performance criterion to determina 


selection standards. Res seri.erionuwas va 
nent and survivalability  measurs, the object being +0 
e, um 


Beedict this variable given  àFQT scor 
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ABLE TET 
Percentage of SHs scoring below designated AFOT Score 


Grads AFOT_=<_20_ AFQT =<_50 
E= 7 Su En 
E-2 50 85 
| E- 3 45 78 
i E-4 34 70 
| E-5 30 62 
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Source: Lucie, Pare "Relating Enlista 
to Job Performance 
for Two PER 5 in gs 

CNA No. 04 DE 


ent 5 
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parv dependents and years of education for a cohcrt Group 


of enlistees. His study used a cohort which joined the Navy 


oi 1973, and records of their service were available up 
Bul (977, allowing for advancement To 55. Regression 
models were used in calculating the relationships between 


the variables which allowed for the construction of "service 
stratus" prokabilities. These probabilities show for various 
premnts Cf time in service the likelihood that the Sailor 
will kte either advancsd/demoted to a particular rank, or 
diScharged from the service. Without controlling for aduca- 
tion, Lurie's data (see Table III) show an expected rela- 
tionship between grade and AFQT. While the numbers are a 
ditz:le confusing, it is clear that as rank increases then 
the proportion of low APQT scores declines. However, what 
meet o obvscus from Table LIi #s the combined effect of high 
school graduation and AFQT. LUEIE fourrad That nigh 1 
graduate enlistees wit higher AFQT scores, have a ketter 
chance of advancement to E3 and EU, while the lower AFQT 
scorers have a higher rate of attrition. For non-high schcol 


Meaduates, the probabilities indicate that recruits with 
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This rather striking result cannot 


ential attrition rates as these 
beth lowe ard high AFCT 


SCOICIS. 


E. cR oa Tag ie jaja SN 


Deartrr5buced'*'*o dsfts-- 


are virtually identical for 


Non-high school graduate 
dvance more, guickly zo 53 and E» 


a much higher 


SP See eme O E 





۶0602767۰ 
ates with high 
as SHs believing they should be 
data 


is presented to support 


conclusicn is that it appears 
standards for this rating based upon 
Unfortunately, his 


standards. 


recommenda-ions do not suggest 


Lurie suggests that perhaps non-high schocl qradu- 


isfied with their placement 
better employ2d. However no 
SAS ORTO Na His overall 


Seas. ble TO sot SAILS TAN 
performance criteria. 


any new 


C: SUMMARY 
1. Theory 
It is now pcssible to give a short summazy of the 
theoretical literature in this chapter. SAS) SCs et n 
penu form. 
° acere are 0 6:7 27072177151 -and extrinsz 


an organisation to be 


its selection 


rrccedures. 


» yali dation Oof selection 


'pređdictivet or 


lecneurrenzg! 


produce equivalent results. 


o all selection research should begin with a thorough 
job analysis so that relevant information is chtained 
tomas sist in the development of both criterion and 
predictor concepts. 

^ Ge: ail principles are known which, assist. in the 
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Sei eriomser er’rerion and predictor measures. 


yal a ty coefficients -are susceptible to shrink 
dUce EC a number of factors wiich may be controlled 


adjusted for. 


WR co rola tion cose fro cienes are useful in selecti 
the mest relevant predictors from a large numbe 
potential predicters and asa technical st 
validity; alone taney do nort indicate precise 


the selection procedures should be. 


۶769777026 USADA es ¿can be estimated for the varicus 
predictor'/criterion outcomes, the decision centered 

alidity design appears the most practical and useful 
te detérmine predictor cut-offs which maximise u 
and which ultimately determine the selection system's 


cverall usefulress. 


the dcuble cross-validation design is 
ccring scme scurces of 53260.167 ٣. 08-67 1 +65 ( 


stincdaras Feseatech.‏ روہ ہے 


Eo n eat «Jwe E A AAA n 


e review cf previous studies the following 
u 


Inrra- and Lirmer-job d3fferences (e.c. coumplsx£tv) abe 


uKkeLy torretzeckyche ela-ionship becween predictor 


and erz*srion measures. 


validity coefficients for more complex jobs are likely 


to te higher than less complex ones. 


relaticnships between criterion and predictor vari- 
ables are not likely to be stable over tine as 
training and experience appear to "wash out" these 
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rela ISIS by re ducinqg diiferences in criterion 


performances. 


sooni icant predictor measures found a military stud- 
ies include age, marital status, education, ability 
€ 


st scores and other biographical variables. 
erdterion Measures used p=sviously in the تل ۲آ"‎ 3+7٦ 


have included the following either singly or as conpo- 


sites: length cf service, advancement, recommendaticns 


th 


Or te-enlistment and various misconduc= measures. 


pala 


scme recent studies (e.a. Lurie, 1981) have emphasise 
the unusual moderating effect some variables may have 


cn 2۴۶202 6:627 5+ 
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III. AIM AND PURPOSE OF THIS RESEARCH 
This charter is designed to make a clear statement of 
the aim and purpose of the thesis. ie Sr da 668700662 
synthesise the literature survey of the previous chapter 
into a form which indicates the expected outcome from the 
wma l ysis cf the ratings chosen for study. The general 
design cf the research and a statement of the reasearch 


hypotheses are also given. 


A. PURECSE OF RESEARCH 


Ui 

c 
0 
fu 
æ] 
mw 

pa 
A 
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The cverall purpcse of the present research 1 
O 


r 
sise the available data on a cohort o£ entrants to three US 
E, ratings in order to test the possibility that + 
current selection procedures can be improved. The matin 
are Ships' Serviceman, Personnelman and Aviation Technician. 
The study involves the development of selsction standards 
which it is hoped will erhance the total effective perfcr- 
EE of future entrants to these ratings. 

There arə several secondary purposes. I 
w erences will be examined in relation to the level o£ 
somoiexity cf each rating. To tnis send, raj na 
chosen deliberately with the intention of having a wide 
spread in terms cf jcb complexity. The Iesearc 
to examine rating differences with respect to 
p eria cf performance both ior single and compesics 
sures. nally EES mcd to apply ihe concepts of 

e S 


utility analysis (that is, app g estimatss of th 


n 
and the productivity of sailors as a means of determi 
the selecticn procedure which will yie 

O 


in terms cf total expected return < 
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B. AIM 


Ian of this *hesss is to investigate the possibility 
cf  isprcving the selection szandazds for three US Navy 
ratings. 

DEC C LDLESIGN 


In terms of the theoretical literature, the design of 
the E study ie more "peodoicctowot tnan 2395 2$ "concur- 
pent Neo cEusNStrIctly "predictive" in the classical 
sanse, as it does not include data on all applicants for the 
US Navy, but rather has information on applicants who were 
Subsequently enlisted. The research is somewhat 'concur- 


meme’ in that Sailors within a rating are included for 


ct 
pa 
(D 
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1 
1 
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ct 
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analvsis provided they met 4 
eee ria Of inclusion discussed ina later section. 

After the selection of appropriate Precictor and 
critericn measures, the next feature of the design is the 
"us? of dcukle cross-validation coefficients as an overall 
gauge of “the usefulness of the relationship between cred- 
Bez and criteria aS a selection tool. Doce neces chc 
candcm splitting of the tctal sample into two halvss, devsl- 
Spina a linear regression relationship for each half, then 

n 


wang the correlaticn between predictions and criterio 
a 


t 


measures in Opposite halves, and éveraging these correl 
en 


+ 
t-4 
3 


Penes tc get an averege validity coeffici 
using the data from cne half to predict the behavicur cf the 
ener half. 

Using these linear r=gressiors models, it is intended to 
piy estimetes of utility and disutility (i.s. the ex 
to which a particular selection outcome gives a positiv 
negative return to the enplcyer oorder cO 57569 
optimal cut-off value of predictions to maximise the + 


= 
expected utility. This cut-off value will be expressed as 
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percentage improvement on the total utility obtainatle when 
tke predictive equation is not used. 

The design also includes an analysis of the 
moderator variables (thes= are variables which interact with 


Help redicicris). One of the most important in this study is 


O 
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job complexity. Others which have been shown + 
eane in other studies, and which will be addressed in this 


study, are race and sex. 


D. RESEARCH HYPOTHESES 


While this research in morea empirical than theory based, 
it is possible to formulate at least two research hypotheses 


based on past findings. 


1. Hypothesis_ | 


uml et ee EE کت‎ 


Age, educaticnal level and mental ability/apticude 
Bere amengst the variables found to be significant prd- 


aas CL Criterion performances. 


Vel queres cor ele APDred: ctor/cE. terion “Isqression 
equations will tend +o increase es the level of complexity 


cr the Navy rating increases. 
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IV. METHOD 
This chapter describes the execution ol “he research, 
Cr a section by section basis it deal Wa En ne T 
selected, the data kase, the variables used, the 


chosen and tha statistical analyses employed. 


A. NAVY RATINGS SELECTED 


As has already been mentioned, the zatings in this study 
are Ships Serviceman, Personnelman and Aviation Technician. 
They were chosen because they represent varying degrees of 
MOD Ccmplexity.  Acccrding to a conpiexity scale (see Sands, 


1979) these ratings have values of : 
a. Ships Serviceman : 40 
b. Perecnnelman NG 


C. Ayrasion Technician 95 


The whole scale has a range from 10 <o 99, with a median 
Né OE 70, and the most ccmplsx rating assianed a 99. 
These ratings therefore are representative of the spread cf 
Bomplexity cf ratings in the US Navy. 
Admittedily, the ratirgs diffar in teras of the nature of 
the wcrk as weil as in complexity. mus 
ENgustlcent causes of rating differences and may influ 
the cutccme of the study. A more ideal approach would ha 


e 
V 

been to select different levels of complexity within the 
Ow 


pa 
pa 


Same type of employment. However, the data did net a 


such a fine classification of personnel. 
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Ancther variable which will obviously have ar sffsc- on 
Bis Outcome Of this study is the fact that for all ratinas 


an existing selection procedure is in use. It as: = 


d 


t 
entrants exceed particular ASVAB subtest scores, as well as 
aching a certain SCREEN score. The SCREEN score is 
Explained in detail later, but it is a probability whic 
represents the chances of the applicant completirg his 
pericd of services (Sands, 1979). The probability is derived 
Seem a consideration of race, AFOT, marital status and high 
Senocl dirlcna status. Suehspreseresening Will. tend ro 
E TICE the range cf both predictor and critericn variables 
which will have an effect on validity coefficients. 

ANE NET al MOESETI[t-On of each rating, which is taken 
Beencipally fron the US Navy's "Enlisted Career Guide 
31-82", fcllows. 


1. Ships Serviceman (SH) 


E e o e O mi am. > ams 


At a primary isvel, depending upon their specialrv 
WESI may work in a karber shop, Ship's stoze, laundry, dry 
ning giant or office. Subsequently they may assume more 


a 
B e in supervisory and managerial roles associ- 


ted with retail stores, commissary stores and laundry/dry 
E... BT Amcng the distinguishing characteristics 
nis particular rating is an emphasis on basic interper- 


sonal skills. While the actual employment may var 


Y 
ical surrzcundings and requirements, the jobs ail h 
Bordo With dealing and interacting With other pe 
affinity fcr dealing with people is therefore e 
Although there is not a requirement for high lev C 
EROS, it is nonetheless important for SHS to be o 
average ability in arizhmetic and in such things e 

keeping and detail  wcrk. EEG 2630328 the SH 
ttends a 6 weeks! ccurse in the trade. There are abcut 


& 
5,000 perscrnei emplcyed in this rating at present. 
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53761 Ss EEES CAE Si man IS a rating which special- 
ises in clerical and counselling duties wich 
personnel. They previde information and counseliing to 
wi sted sailors related to Navy occupations, oppoz*unities 
for general education and job training, promoticn 
Dents, and in rights and benefits. Rewer ToC Ts 
the FN completes a 6 to 7 week technical school. The 


about 7,000 perscnnel empioyed in this rating at prese 


ge Aviation Technician (AT) 


The SANAN LE ODS cag is Aviation 
ENc*ronics Technician. As the title sug Ro, Sa 072775 
the rating are emplcyed maintaining advan 


1 
aud. elsctronics equipment that are 
EREUCDoft. ‚Within this broad area of r 
are three catagories cf emplcyme 
meeting and analysis of e 
repair, and in related admiri 
aa ning, the AT attends up t 
Benoolina, and depending upon whether “he ATi 
Bayıyeaz cbligatcr, he/she goes on to do a further 6 months 
of advanced first term avionics. The rating employes ۳ط‎ 
a 


NUDOU) perscnnel at present, and there 


B. LATA PASE 


The cohort data base was assembled by the Defense 


Manpower Data Centre (DMDC) for the Administrative Sciences 
Department cf the Navy Postgraduate School  (NPS). 66 
Bra cn some 206,000 non-prior service sailors wera obtained 
through the merging cf three usually separate Navy files. 
These files az? referred to as the DMDC file, the 
Advancement file, and the Navy Health and Research Center 


MARC) file. 
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The DMDC file contains pre-enlistment varia 
as entry dates and current status. It Was a 
linking varicus copies of the Enlisted Mastez R 
+ime using Social Security number. This number 
Mm the final cohort file in the interests of privacy. 

The Advancea=nt file records variables related <tc “he 
meomoticn cf individuals through the advancement system. For 
exampis, this file previded values foz the Final Multiple, 2 
composite score, which determines wnsther the sailor is 


Emomoted. 


The NERC filə contains many of che same prea-entry varia- 
bles as the DHMDC file, but records additional prs- and 
post-entry variabies. Amongst these are aptitude scores on 


the Armed Services Vocational Aptitude Battery (ASVAB) 
subtests and percentile scores en the Armed Ferces 
Bwa lificaticn Test (AFOT). The file also contains such 
things as the total number of absenses without leave 
(AWOLS), demotions,  desertions and the times foz proaction 
to various grades (eg number of days to EY). NHRC xs the 
largest of the three files. 

mie wechCre file included data from all exlisted entrants 
to the Navy between 1 September 1976 and 31 December 1978. 
No special data collect or monitoring cf these subjects was 
set ur; rather snapshots cf their progress were taken in 
Sepremter 1982 from the various files to create the NBS 


Senort file. The time period allowed «sac 


2 
y (P 
bou 
pa 


S 
EEpurtunity of serving about fcur years, with some teing 


able to serve as long as six years. 


C. VARIABLES IN THE TATA BASE 


There are over 260 individual variables in the cohort 
data base, and those relevant for this study are descrired 


below. 


46 





Three critericn variables 
while the cthers are composites 


total length o2 service in months 
the cohert and is 


Th? Ss 


members cf a 
for regression analysis. 
tively oriented ordinal scale. 

collectively exhaustive ca*egcri 
identified. These individuals 
BT 


trence reesons, 


years service for ctner than 
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did AOE CONDI 


desertion, 
received Oh 
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re-enlistment regardless of their 
nogu, The 


exhibit any particularly negative 


includes those 


or those whc demotions or 


remainder of 


valued 


the third category which was valu 
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While these criteria could be define 


-oments 
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ways, they seem to be consistent with the thr 
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suggested in Chapter II. 
2. Predictor Variables 


The following potential predictor variatles are 


eomtaaned in the cohort file. They are: 
a. age at entry; 
Bee) Marital status; 
C. highest educaticn level reached; 
d. number of dependents 
e. various ASVAB subtest scores (in raw score form); 
f.  AFQT percentile scores; 
ge groupings based on AFQT scores; 
mee entry ray arade; and 


SCREEN score (which is the probability of completing 
the period of enlistment based on education,  AFQT and 


mace). 


These variables have all been prev 
predicting criterion measures in mili-*a & 
settings. They are consistent with the three تا‎ 1-2 02 2 


Bs predictcrs menticred in the literature survey. 


ae Moderator _ Variables 


As was pointed out earlier, LeS Suspected irar 
complexity plays a mcderating role. This has been accounte 


d 
foe, parrially at least, by choosing three ratings which 
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Cover a wide span of complexity, and for which di 


selecticn procedures will be developed. 





Race is another variable which may play a mod 
role. Provided there are no adverse impacts for mincri-is 
as measured by hiring rates, it may be possible to ap 
same selection procedures across zaca, to tte r 
whole. Alternatively, selection orocedures base: 


d 
cally on race groupings may produce a better overall res 
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In any case, previous research enmphasises wisdom o 
mice into account. 

Sex is another variable which is believed to play a 
moderating role in this research. In this study, there is 
sufficient number of white females to perform analyses on 


two rating groups (these are PN and AT). 


While =the accuracy of data TICS Mato tne original 


(D 
p o 
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three data files is unknown, it is sumed to be very high. 
However, some cases were identified in zhe cohort data ser 
which had impossible values. FOF example, no entrant to 
the Navy can be less than 17 vears old, but some cchcert 
members were listed with an entıy ge less chan 17. Thess 
Cases were excluded. Similarly, sach of the ASVAB subtests 
has a known maximum number of items, thus cases with scores 
higher than these limits were excluded. Because the 
criterion measures all required that each sailor have “he 
BEBOTtUNity cf serving for at lees: four years, then thos 

Sailors whose enlistment dates precluded serving this reriod 


were excluded. 


The exclusion of cases for these reasons was list- 
Wisat, That is, the case and áil- irs variables valuss was 
deleted. The percentage of cases deléted in this way 


PIN TET to less than 5%. 
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EKS ESETMate2t of Utilstt 


Es Ta rqu Edwin Chapter II, if a sSi9ni22cant reia- 
tionship between predictors and the criterion is found, then 
estimates of utility for various selection outcomes become 
moor ant ter deciding the optimum cut-off on the predictor 
to achieve the best overall selection result. This invclves 
MeeecManing the cut-off level on the predictor for which 
total utility is maximised (see Table II and related discus- 
on). This section discusses the derivation of the eszi- 
meses of utility. 

Ic estimate the utility associated with sach of tha 
four possitle selection outcomes it is assumed that the 
Billet Cost Model (sse Griffin, 1981, for an explanation o 
the ccst componerts ct this model) provides reasonable sesti- 
mates. As is discussed by Campbell (1976), it is the in 
call ratios which are important rather than the absclute 
values themselves. The Billet Cost Model vo a h 
C approximating these ratios. 

Ber co rectly -predicting a successful sailor, "who 
Will complete four years of service, the total mar 


is taken as the bast estimate of utility. 8 9 


FU xD 
c 
fv 
(A 
iD 
fu 


O 
the assumption that the Navy compensates sailors at the full 


value of their marginal product. This is probably a consér- 
vative estimate as a ZÈCENt paper  (Bucier, 1982} has 
suggested. Butler has calculate for sc 812070 
Technician Rating, based on the amount of training dellars 


the Navy spends on these sailors and their expected total 


service, that the Navy must expect a return in oca 


(n 


rthelsss 


ccnsiderably in excess of rating billet cost. Nev 


لح 


D 
0 
ct 
I^ 

i 


= 
Ble tctal billet cost figure is accepted as the bess 
D 


EE of utility for this outceme (1.6. correctl 


ES 


success). 
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An estimaticn of the 83" ةە1+96 ۷۹9۹ھ‎ > 
Euccess, wen in fact the sailor fails the crite 

provided by the rating cost es 
Clay-Mendez (1982). Basically these data com? from 
Billet Cost Model, but include only a few of che elaments 
the crigizal model. The Balis and Clay-Menáez cost a 
are th: average replacement costs by ratings across 


S 
ealed quality gradings. The cost of the replacement of che 
a 


highest quality grading is used in th: present study as the 
EI mats c* the disutility cf falsely predic-:ing succsss. 
Relevant produc-/cost figures are not available for 
the utilities associated with applicants who are rejected by 
tha prediction device. However, these utilities are derive 
from the akove estimates. In the “Case. oi, The 4 ۲97 
correctly rejected (he/she would have failed A eae 


criterion measure), i- is arqued that this select: 


has the same utility as the disutility ass 

Pakane who fails the criterion. Therefore, tre WASIS 
Beer data is used as the utill-*y estimate for this selection 
outcome. 

Ire dug LIU TOE tte rejection ol the potentially 
successful applicant is derived as follows. The disutility 
associated with this outcome depends on the recruiting 
market and whether it is easy or difficult to get sailors. 
In scme circumstances it could be that chere are so many 
good quality applicants “hat rejecting potentialiv 
successful applicants has little cz no disutility. On 2 
Az eme value for this utility, therefore, coula ba zezc. At 


۰ 
— 


EWEWÈther extreme, the disutility of rejecting thase appl 


ja 


Emre cculd be equal in magnitude to the utility 


2 
«¿he disu- 


) 
O 
th 


enlisting a successful applicant. The estimate 
meet y cf rejecting a pctenctially successful apliicant is 
taksn as the average of these two extremes. Pie Ute sey 


waluss, by rating, are given in Table IV. 
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TABLE IV 
Relative Utilities by Rating 


Pee. a a PREDICTOR 
*** SUCCESS *x*X Kee FATLURE *** 
Ge secu cnr Cri ee CH GE Esion Critsrien 
RATING Success Failure Success Failure 
EH 19260 -13077 -9630 123977 
EN 18488 -14495 -9244 14495 
AT 22297 -21210 -11149 21210 


The above utilities are used to derive cut-off 
scores for all three cr m 
Eyi ce (LCS) critericn they 
pues fcr each of the four po 


the qoodguy and badguy scales th 


(D 
ect 
f» 
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(D 
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fu 
(n 
ci 
E 
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develcring utilities as described below. 


TABLE V 
Relative Goodguy Utilities by Rating 


REDI TO RW ge ہے ہے‎ PREDICTOR 
we SUCCESS *** *** PAILUSE *** 
Criterion 809 ۴۶ 
30 20 10 30 20 10 


SH AS OO 2192607 =9630 7+ 
EN 27732 18488 -14495 -18488 -9244 14495 
AT SOO TT SENG —-22297v-11149- 21210 


For thse  gdoodguy scale, there are thras c 


fu 
OH 


cutccmes, which for the purposss of establishing 
gives a total of six possible criterion/predict 
Bons. The scale values 20 and 10 are taken to 


pres as shown in the above table. The utility cf correctly 
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Peccicting a goodguy 30 is computed to be ons and a kalf 
Ames the utility of correctly predicting a goodauy 20. AS 
was dona in developing the above values, the disutility of 
rejecting a sailcr who would have been a goodguy 30 is “aken 
as the simple average of its extreme values. As can ke seen 
e rabls V, the figure for SH is the average of 28890 end 
9630. 


TABLE VI 
Relative Badguy Utilities by Rating 


PREDICTOR -2-------- PREDICTOR 
٭٭٭‎ SUCCESS *** xX FAILURE *** 
Criterion GE COLON 
30 20 10 30 20 10 


SB 19/2/50 9030 7€ 1966- "79630 7-713077. 16347 
18488 14495 -21743 -9244 -14495 18119 
AT TE TO SSSI 219527219 26513 


so larly tner badguy utilities, shown in Table VI, 
Exc derived starting from those in Tabie IV. These TOUT 
e ties represent the cutcomes for bad guy ecriterior 
EBES Of 20 and 30. Aqain, it was figured that the utiiity 
cf ccrzsctly identifying and rejecting badguy 10s was one 
and a half tines the utilit OF 0ج 3ت‎ 7۰02016700 2۰20 
As fcr the  goodguy scale a simple average gave the utility 


for the cther outcome. 


LS SUBJECTS CHOSEN 


Withir the NPS cohort file zher2 are thr 


11) 


e  pcssi5l= 


S follows. 


(W 
۸ 


indicators of a sailor's rating. These ar 
m EStly, there is a ra*ing recorded at the time of entry. 


secondly, when the sailor attempts the rating examination, 
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Ene resulting rating is recorded. Thid Ey, the DMDC rile 
mains a rating which is the sailor's official designatior 
E terms of rating. These ratin variables are kroun, 
respectively, as (1) entry rate, (2) examinaticn rate and 
(3) DMDC rate. 
mt weuld be an ideal situation 1f all three rating vari- 
x 


ری 
¡a‏ 
)04 
< 
fU‏ 
٢‏ 
pa‏ 
0 


ables agreed. However, there is considera 
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the recordings of rating across these varia 
there are a total of seven different combinations when it 
@emes to selecting suitable subjects for a particular 
pscing. These seven possible combinations ara shown in the 
Table VII. 


TABLE VII 
Possibilities for Selecting Subjects within a Rating 


| Ra INGO Indicators 


en‏ ہے ہیں ود ویو ہو می شر و شا 





لے مس 


























| 
| Category | 7ھ‎ | Exam | DM DC | 
== A O Y A 
| i | Yes Yes | Yes ] 
L`e Yes Yes | NO | 
دہ تد جو جع سد = د د‎ | 
| d { Yes | No Yes 1 
A eeepc + - à 
| 4. | Yes | No | No 
ee ج د‎ ze 
D NO | NO | Yes | 
a nenn € ze KI ——— 
Du NO ¡ Y 2s | les | 
| T: No | NO { Yes | 
= A A A n — MÀ مس‎ 
Mete c1]: 'Yes' means that the data fils indicated that 
the sailor was a member cf the rating according 
NEM C po Dake Ou lar Tee2ng 3007705-0 
Note 2: In choosing subjects who were representative 
of rating membership, all th? anove Categories 
except #4. were used as selection criteria. 
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Mere la re a1 NUDES CI UeVS  rOr determining which 
EubYyects inr the listed categoriss arə zep 


maing, One method could be to s 
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who were coded in the rating for ali three ra 
variables. Bile ents sap proce would. ser-ouslv res--ic 
sample size and „indsed, it would probably not produce a 
repesentative sample cf the members of the rating. 

a 


Of the seven possible categoriss listed in T 


Was decided to initially select on all sawan, ther to 
exclude thcse sailors in category 4. Thats S/a Tae ecl 
EMOns were those Navy entrants for whom the only indication 


cf membership oz the rating was their entry code. It was 
reasoned that while these sailors showed an interest in the 
mera ngd at seme stage prior to entry, there is no indication 


at 
that he/she had ever had any work experience in the rating. 


From a ccncurrent validity point of view, it is necessary 
foe the subject sailcrs selected ¿oz a rating to at leas: 
experience it and to have their rating performances influ- 
enced by that TS Presumably the sailors who were 
ہد کک‎ in th= rating through the examination rate or through 


a DMDC cede have had sufficient experience in the rating tc 
b= considered representative of the rating. 

After these variable screens were applied, and cha 
rating categories identified, subjects were chosen within 
each rating. These selections are shown by race and sex in 
Table VIII. As will be seen in the results section, if was 


Eceded that the mumbers in some of the  -ace/ssex con® nra- 


( 
(Dp 


Bons were tco small to perf realistic analysis. Ther 
are sufficient numbers of men in each race grouping. dowevec 
BUEPS are enough white women in oriy the PN or AT ratings “zo 
perfcrm regzessicn and other analyses. Therefor 

subsequent analyses, three greupings for SH, and four each, 
Bee EN and AT, are reported. 
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PABLE VIII 
Rating Selectees by Rating, Race and Sex 








T S ٦‏ ہے جو ہے سے ےی NU au EE‏ ہے ہے تیووس mmm I ze oh‏ شش را 
| | ۱ ! : ۱ | 
FATING Sex White | Black De Sa NG TOTAL |‏ | 
[ سإ I I‏ 
SH Male 1330 572 169 ۱ 2071 {‏ | 
SH Female 28 7 2 37‏ | 

| EN Male | 126 3 288 | 112 ‘ 1663 | 
L EN Fenale 479 70 que 564 

| AT Male | 3400 l 176. | 114 | 3690 | 
| AT Female] 2 ٦ 14 | 3: | 260 | 
b ec um E E e d soni vua o or wann nen aaa ami ang ag سے‎ cl 





Note 1: The number of personnel are shown in each cell. 


Eee STATISTICAL PROCEDURES 


t General 


Now that the criterion, predictor and mcdsrato 
Variables have been indicated and the subjects identified, 
the statistical procedures will be des 
Statistical Analysis System (SAS) package (S 
used for the analyses, along wich some FO 
Rotten by the author. Sample programs are listed in 


Appendix A. 


These are given by moderator variables, and consist 
of the sccre and/or mean values on predictor and criterion 
Variables. No statistical tests are applied to these 
values, since where Significant diffarences occur these ars 


"Captured" in the subsequent analyses. 
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Fcr each rating Loup the Tollewing 


in 
(4 
iD 
rm 
un 
I» 
t1 
a 


a. stepwise  reqression is used to identify significant 


Mee those significant predictors are used in 'crdinary 
least sauares! regression to develop 'doubie cross- 


wededation'* vals:dity coefficients; and 


(ip 
O 
n 
ct 
cy 
(D 


€. regression weights are used to score each cas 


espective predictor equations. 


When the group size was all; the Cunber" oi predicilor: 


sm 

used in the subsequent stepwise analysis, was limited to one 
variable tc every 20 personrel. As a consequence, “he 
‘other! racial category for ATs was limited to the first 


five variables selected in the stepwise procedure. 


4. Estimation of Cutz 


= ea MD SS ea 


T061 tordinary Llazo ۲٦541002766۴۲۲3 292768 7 equations 
described below. 


S 
are used to estimate optimu S 

In crder to use +h ity values to estimate th 
most idsal cut-offs on the pre 1231-9 sS Lirs= necessary 
1o*tonmous veri- 


ENG 
g oups: “hose 


d 
quie S 
me consider the LOS criterion measure a 
able. Thus the sample 2s° divid 
h 


with less than four years and + urs years oz mote 
of service. The twc three-point criterion scales were not 
recoded. 


AS S m gscreteod in “fhe Appendix A, -during < 


h 

ble crcss-validaticn SAS run on the computer, criterion 

measures predictor scores and the variable race were outpu 
h 


to a separate computer file which could be accessed by ti 


FORTRAN program. Trerbredictor: score .ouxspu. et this stage 
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Vals derived in the fciloving way: the separate tegression 
coefficients, in each of the cross-validating samples, were 
used to separately score all the cases producing two prec- 
icted sccres for each case. A simple average was zaken, 
mech represents tke predictor score output fcr later 
FORTRAN analysis. 

The method fcr estimating “he most appropriate 

zh 


m 


cut-off score was explained in Chapter II. In summary, 
cutting score chosen is the one which maximises equation 
oe 


Uc = Sum cf ( Pr(i) * Ut(3) ) (san saa) 
where: 
Uc Sa Oral UE lity “tee CBT NG core C. 
Pr (i) PS NEMBE abah TEY orcontcome (x) 
ge (3) SENE UCIT ST Of Outcome: a). 
The results cf these analyses will be presented in 
ussocHuical fora. In crder to get some fram2 of reference Tor 


evaluating che value of the chosén cut-off score, the 
cuc-cff is expressed as a percentage change fron 

known as Lase rate. The base rate is simply defined as the 
Bede Of equ-ion 4.1 when the cut-off is set so low that 


Ev epplicant is accepted. Unfortunately, base rate is not 


ome true utility of the current selection, saa TS 
represents the assessment of the utility only for those who 


are seiected by these procedures, ignorin applicants whe 
are rejected by them. As is discussed in Chapter VI, the 
mall utility c a selection device must take into account 
the ccsts involved in setting up and maintaining the system. 
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Eus, base rate, as defined he 
which igncres these external cos 
Suze for judging zach potentia 
for each sccre is expressed asa 

p 


positive or negative, from base 
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V. RESULTS 


mer‏ ڪڪ ” ڪڪ 


This chapter presents the thesis results and is crga- 
sed into three sections. Lise west fas ZSfeseriptive, 
mao ding breakdcwns cn criterion, predictor and mcderator 
variables. The seccnd section qois! he Foredic.- \ve 
results. This includes the variables selected for multiple 
Mea ressiícn, and alsc the results cf cress validation. In 
INAS CEI, tne results of the applicaticn cf utili- 


ties to estimate apprcpriate cutting scores, 2r2 presented. 


A. DESCRIPTIVE RESULIIS 


1. SH Groups 


Shown in Table IX are the means and/or frequencies 


Bacatsgcry for potential  p-cedictoz and criterion vastandles 


across the three male SH racial groupings. Wee. “use Peer 
Bang té note that the length of service is greatest for 
Non-white races. Ome O ner elena, bosch che goodquy end 
kadquy scales indicate that proportionally nore of the white 


group have extreme values than do the other two races. 

Amorg the predictor variables  -here are also sone 
interesting trends. White personnel seem to be younger with 
lower educational level. However, with some excepticns, che 
white grcur's performances on che ASVAB subtests are bette 
ENS 0: a ng is cons?scasrt with this azou 


scores. 
2. EN Groups 


> onu ep = oe ee CU a 


TaoesatieenasteC  caenads nortod for SB fen ata evident 


for EN men, as is shown in Table X. The white men zre 
E gntiy ycunget, they exhibit 'good' rather tha ipod 
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TABLE IX 


Criterion and Predictor Values for SH Men 


Variable White Black Other 
Number of Cases 1330 572 000 
Mean LOS: months ٣٢۰۔33۱۸ 02ے‎ 

30 24% 16% 12% 
Gcodguy Scale 29 6 497 59% 
10 43% 39% 30% 
30 23% 17% 14% 
Eadguy Scale 5 ۰ ْ 7٦ 66% 72% 
10 265 17% 14% 
ERELICTOR MEANS 
Entry Age 2ars E7 19.4 21-0 
E tal war دا‎ 1.4 15-5 
Highest Education 11.6 iS 202 
Deperdents (rumber) 0) 0:5 20:2 
AFQT e 46.6 34.7 23 
AFQT Group S 4.5 4.0 
Entry Payirade eel 2 Ta | 
SCREEN Score 802 7924 802 
ASVAS Subtests; 
Attention to Detail 14.6 1929 eas Ss 
Numerical Operations آ20 2د‎ 213 
Autc. Information 10.1 05 3 DES 
Attentiveness Scale 97 10.8 9.9 
General Science 10.4 8.5 3 
Electronics Scals m oo 5 
Math. Knowledge 11.4 E gen 
Space Perception 0 115-1 11.0 
Maintenance Scale 3.9 27 9.6 
Electronic Info. 1723 5 14.6 
A-1 8 ٤ Reasoning 9 llo. 7 ge 
Generai Information 9:4 7 65 
werd Knowledge 19.5 17.5 15.1 
cr Duce: be Son 27 gu 9.4 
Comfat Scale 53 14.1 13.4 
Mech. Comprehension JE 7.4 و"‎ 
Gcodguy: 30 .. served 4 years, promoted 28 98 
recommended £or reenlis-cmen-. 
20 .. served 4 yaars. . 
10 .. remalndsr after 20 and 30. 
Badguy: 30 remainder 2zfter 10 ‚and 202 
20 .. minor negativa indi GOES 
ME TM Day Ene NS indicators. 
Goodguy and EFadguy percentages sum to 1007. 
۹ھ‎ 0 Be values 1 to 8, represent categories 
tn) Order) SOC, UB, 4A, 3B, JA; 


2 and Ms 
Mar- tal sStacusexndrr:ed-(2)$ otbsez (1 
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TABLE X 


Criterion and Predictor Values for PN Groups 


ALE EMAL 
Variable White Black Other Whi- 
Number of Cases 1263 288 112 479 
Mean LOS: months 19272 49,5) 51.9 95.67 
30 17% 9% 12% 21% 
Gocdguy Scale 20 48% 52% 63% 367% 
10 35% 39% 297 43% 
30 17% 9% 14 3 2208 
Badguy Scale 20 M723 813 795 TWE 
10 115 109% 8% 4 % 
PREDICTOR MEANS 
Entry Age: years 1928 2037 1۔21‎ AO 
Mazıcal Staeus 1. 4 1. 4 5 5 
Highest Education T2 TAS? 12.7 1202 
کس و‎ (number) SOU +06 058 US 
AFCI Fercentile 83.0 49,3 34.8 63.9 
AFCT Group S? 25د‎ 3.9 o 9 
Entry Paygrade 1. 4 1.5 Ts 1.4 
SCREEN Scöre 84.3 82.7 82.3 Nene 
ASVAB SUDIESES: 
Marena e ton tO Detail 15.0 14.0 11.8 1o 
Numsrical Operations bur 30.6 23.6 37.8 
Autc. Informaticn ins 8.4 5.3 76 
Actentivene2ss Scale ES 12.6 9.0 12.6 
General Science 12:6 TOUS 7.8 MAS 
Electronics Scale 7.9 8.9 6.9 DAN 
Math. Knowledqe 13:7 11.1 8.8 13.8 
Space Percepticn 12.8 VIA 9.4 2. 
Maintenance Scale 9٦ 9.1 795 Oun 
EARL Chic INEC. 19.3 16.7 Tou 15.8 
Arithmetic Reascnina 19.0 1228 Du 14.3 
General Information 19.6 876 002 8.1 
Wcrd Knowledge 25m 22.0 14.7 24.6 
Shop Information 13.6 1027 ac 9.9 
CcmEa* Scale 12.8 14.6 Veet 1 
Mech. Comprehension 11.0 8. 1 7 9.4 


on the ASVAB and “the 
BEOT than are the men in the other racial groups. 


benaviours and are better performers 


The scores of the white PN women, not surprisingly, 


are closest to the sccres of the white PN men. The women, 


however, have considerably shorter average lencths' of 


EErvlce, tut exhibit a higher proportion of "good" rather 
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TABLE XI 
Criterion and Predictor Values for AT Groups 


| | MALE FEMALE 
Variable White Black Other White 
Number of Cases 9939 172 109 242 
Mean LOS: months EEUU ES 3: 399.4 5116. 45:37 
30 18% 10% 18% 14% 
Gecdguy Scale 20 52% 57% 43% 44% 
10 30% 33% 34% 42% 
30 19% 10% 16% 1 
Badguy Scale 20 76% 83% 827 76% 
10 5% 7% 2% 37 
PRELICTOR MEANS 
Entry Age: years 1921 20% 3 20 2926 
Marital Status 163 1.4 aS a 
Highest Educaticn 12.09 1222 1222 25 
Derendents (number) . 06 .09 $198 08 
APÒT Percentile de MOND 534,0 pos 
AFCT Group 6. 7 5.9 5 "m 
pere Paygrade je 1.6 125 1.8 
SCREEN Scöre 86.2 83.6 83.9 None 
ASVAB Subtests: E : 
Attention to Detail 19.2 Pas 5 15:32 1687 
Numerical Operations 39:9 3d 3395 10.5 
Autc. Informaticn 14.7 19.9 11.1 10.0 
۸> 1ء۰‎ We 85 9.4 10.9 3.3 12.4 
General Science 14.9 12.7 1205 1053 
Electronics Scale LO. 11.5 10.5 9۔٦‎ 
Math. Knowledge 16.0 1393 14.5 10,5 
SIC ۲6ت‎ 6262 7 1029 22 14.0 Tos 
Maintenance Scale 12:0 10.7 1050 Se 7 
EE CE OD cnc. 24.2 22. 21.0 20.23 
Arithmetic Reascning Med 14.0 13.8 16 1 
General Information 6 TOS 1 9 d 
word Knowledge 20.77 200505 19-6 26.6 
au Informaticn 16. 2 1223 132,2 2.3 
Comtat Scale 16.4 14.6 1423 12.0 
Mech. Comprehension 14.5 10:7 MI TISE 
NOTES: AS for Table LX. 
' bad! behaviours. On ASYAB subtests “he women, when 


compared with white men, are better on soma scales (2.9. 


Numerical Operations and Word Knowledge), poorer on seme 
GCthers (€.qg. Auto Information and Electronics Scale) and 
about the seme on the remainder. On educational level, the 


women have entry educational levels which are within the 
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extremes of the three male racial cat2gcries on this vari- 
mele. Incidentially, it is the male 'other' race 


C 
which has the highest educational level fcr “he PN .8۴ج‎ 


3. AT Groups 


For the AT rating perhaps the most striking fact is 
a 


the propertion cf ATs who are white (ses T 


92%). This is considerably larger “han the equivalent 
percentages for PN ( 76% white ), and SH ( 64% white ). 

The trends in the AT date are consistent with these 
already mentioned for ENs and SHs. Again, the white group is 
younger, with lower education  levei and generally better 
AFQT scores. However, for AT there are proportionally more 


Placks in the negative category of the 'bad auv' scale (i.e. 
BhOSc scczesof  '10'). Women again have superior períor- 
mances on some ASVAB scales and, for this rating, they have 


«the highest education level. 


B. PREDICTIVE RESULTS 


se regressi 


0 
3 
(n 


ie ens "section the results of the st 1 


, 


Ber 
lowed 
odels 


Ficieness and siatis> 


E 


= 


epwi 
in the fcrm of the variables selected and ths signs o 
respective coefficients, are present are fol 
2mmediately by validity estimates fcr the predictive m 
Wi eh are constructed. Regression coe 
tics are nct listed in the body o S: however, 
interested readers are diracted to Appendix B where they are 


geyen in full. 


For the SH rating, the variables selsecreä as pred- 

Eeors on the length of service criterio 

the sign of he coefficient, are shown on T 
O 2 


Across races ali the signs are Cc 
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TABLE XII 
Stepwise Regression for SH on LOS 














Variatle — White Black Other 
[ Entry Age: years | 1 | Pos s | 
| a tal Status | Eos oe n | 
| Highest Education | n Pos n | 
mao centi oL te Detail n n I Ng j 
| Autc. Information Neg n | now 
| Attentiveness Scale Neq Neg “| 
| General Science | n | n | Pos | 
| Arithnetic „Reasoning n | n | Neg 
| General Infcrmation | Neg | n | Neg | 
| Mech. Comprehension n n Neg | 
| Comtar Scale | n | Pos | 0 
AFCT Group | Neg | Neg | n | 
Entry Paygrade | Pos | n n | 
SCREEN ٤ ll eS | n ٦ 
| Dependents (number) | Neg n | n | 
——————————————— — HN n 
Note 
Pcs means the coef£iCien-t was positive 
Neg means the coefficient was nega- ive 
tnt! means the variable was not sélected. 


which entered the equation in more than one racial grouping. 
Entry age, marital status educational level and entr 
Paygrades are all A related to length of service. 
Longer service is associated with higher values on these 
variables. Neatly all chè predictive ASVAB subcssSts,- and 
the AFQT groupings, are negatively related to iength of 


service 


As shown in Table XIII, there are some differences 
in the signs associated with predictors for tne PN groups 
for the length of Service critsrion. For whites and blacks, 


higher education is associated with shorter service, while 


for the 'cther' race category, the reverse is true. There 
ares mixed signs for the ASVAB subtests, but the SCREEN score 
ccnsistentiy has a positive sign. Some ASVAB predictors for 


length cf service, in the female group, have negative جک‎ 
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Perhaps this is nct surprising, because as was 
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earlier, women tended to have shorter service but 


ASVAB subtest sccres than did men. 
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TABLE XIII 
tepwise Regression for PN on LOS 


























] MALE PENALE 
Variable White Black Other White 
ENGINE ee ہہ عو‎ n n A جس ےہ‎ D D SE وچ ہج‎ ۷۶٣٣۹ 
f EY Age: years | 2 | | n n ٦ 
| eee al Status Pos | Pos | n | n | 
| hest Educatien ! Neg | Neg | Pos | Neg | 
| ae ention <o Detail | n | n n | Neg | 
{ Numerical Operations n Neg | n | n | 
I Electronics Scale | Pos | n | n | POS | 
| Elecrrenle Intec. | POS n | n | n | 
Arithmetic Reascning Neg | n n Neg | 
| Word Knowledge | Neg | i ll n | Neg | 
! Ccatat Scale i n Neg | n | ne J| 
۲٠۶٠-٣٢6 CN j Proe | na LI nome po ٦ 
| BE ne i n | Nea | n | sa | 
mc aygrade n a n os 
| Son 3 Sees | a ۱ M | Ve ¡ n | 
ependents (number os os - n 
NELLE UE I. qiero se aee ue or 
NOES 
neans ue En pus was positive. 
eg means the coefficient was negative. 
in! means the variable was not selscted,. 
TABLE XIV 
Stepwise Regressicr for AT on LOS 
MALE PAWALE 
Variable Wats) Black ther White 
۲ E. MN AN ul cu uer ces recor eade c toro I ET. m ru 
Entry Age: years | n | n | Pos n | 
Ya ial Status Pos | Pos | 2 | Nsg | 
| Highest Educaticn | Neq | Neg | E! nm 
| Numerical Operations | Neg | a | n | na] 
Aus 7× | no n | Nog | n | 
| Attentivensss Scala n f Pos n n | 
| General Science | Neg | Neg | n | 00ھ‎ 
elect conics Scale | POS | DONE 2x | Neg | 
| Math. Knowledge Neq | S P X n | 
| Pace PECTED ICD Neq | n | n | n 
Maintenance Scale n | A POS POS 
20ت‎ ۲66 36 5 n | n Pcs | Pos | 
| SHOT Informi icn n Neg n n | 
| ABER our ile | MEE n : n n | 
D roup Neg a n n 
| Entry Paygrade | Pos | n | ne n | 
| SCHFEN Score | Pos | n | Pos | n | 
e o € J 
Note 
Pos means the coefticient was positive. 
eg means the coefficient was negazive. 
means the variable was not selected. 
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Like ¿he SHS, eere CONSISTENCY Of Signe fat 
stepwise entered predictors for che AT ratin 
BY) for length of service. However, che dir 
signs, fer some variables, pom Pene. For example, 
educatioral level fer two racial groupings, is n e 
tively related to length of service. This si 
carried over into tha ASVAB subtests. Being suc 
cally  ccmplex pacing, one would expect S 


th 
{N 
D 
13 
ہے‎ 
۱ ' 
0 
iD 


Mathematics to be positively relazed c length 


However Bo GCE these scales have negativ 


(n 
p 

Q Q 
3 
m 
. 


Consistent with some of the other stepwise egr 


ess 
SCREEN score is positively related to length of service 


u a ai‏ ع see oe ME‏ ےت 


Table XV shows the variables selected by race on the 
S 


Meoaguy scale for the SH rating. This is <he  smailes- 


TABLE XY 
Stepwise Regression for SH on Goodguy 


Variarle White Black Othsr 


ne AOS aus | pos | Pos | n | 

















| 
| Highest Education | Pos | | n | 
| ۲ہ‎ On ۱ n | a | Neg | 
| e ain cs Scale | Neg | n | a 
| Math. saa de | Pos | n | n | 
Flecttonic Info | no] n | Neg 
U Onat Scale | n | Pos | Pos | 
IM NOT Percentile | n | n | Neq | 
| AFCT Group | n | Neg | 8 | 
CREEN SCOTE ni Pos POS | 
LII ————————  — aan Ad u 
Note 
Pcs means the coefficient was positiv», 
Neg means the coefficient was negative. 
tn? means the variable was not selected. 
number cf variables selected for any of the stepwise 
regressicns. The sign are ali consistent with the pred- 


Bear zseleczions for SH cn length of s 


NS int 


(D 


e 
ے52‎ CO NG € Cha AEOT percentile, ter the ‘other’ 


2 





Mae al category, has a negativs sign: lower AFQT percentilas 


fem Predictive or better goodguy performances. 


TABLE KUT 
Stepwise Regression for PN on Goodguy 











MALE FEMALE 
Variable White Black Other White 
i e F [Li ak ns Ree ene fa EE SEE 
162۰9 >5 7۳۰۴ 3٦1 - | Pos | n | n | n ] 
| Highest Educa tcm | Neq | Neg | Pos | n | 
los en Yon o Detail | n | n n Meg | 
| Numerical Operations | 7 ! n | n | 
Eleetzeenics Scale | POS | Neq | n n 
| Math. Knowledge . n | Pos UE n | 
| Mech. Comprehension POS | n n | 7 
تہ‎ ne | 0۶ eos n | n 
| Arithmetic Reasoning | Neg | n | Pos | Neg 
| Werd Knowledge | Neg | 25 n | Neg | 
| CcrEa- Scale | { 2" ss | POS | n | 
| General Information | n {| Pos | n | n | 
وت‎ ۱ 9+ ٤٦ | n | Neg [ Nag | n: 
| AFCT Fercentile | n | 23 | Neg | n | 
| e SCore fi | ae | n | f: | n | 
spendents (number os n Ne n 
| Dependents (nu Pa ۷ٰ" E ES mE 
Note 
PCS means the ےو‎ ۶2 10 Was posisivye. 
Neg means the coefficient was negative. 
'n! means the variable was not sélected. 


As was the case on the length of service 

Ep c erion for PNs, the level of education is negatively 

related tc the goodguy scale. This is shown in Table XVI. 

ASVAB subtests selected have varying signs and for two 

Ee 21 grcuro2ngs for men, the variable ‘number cf depen- 

dents! has entered the zegression equation. De SCREEN 
p 


score for white males is positively related to desirabi 


wW 


goodguy behaviors. 


Or ThE AT | Groupings, on the goodgiy scale, $ 


iD 
ib 


٠ * 


ibis XVII, there is little consistency regarding wh: 


ps 
Q 
rm ja 


a 


variables are selected. Only three predictors were chose 


r1 


in mecre than ore grouping, and whan this happened th> sign 


, 


are different across groups. It is interesting that fcr the 
largest croup, white males, not a single ASVAB subtest is 


selected as a prédictor. 
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B‏ — —— امم کہ چھ 


TABLE XV 


II 


Stepwise Regression for AT on Goodquy 











MALE EEMALE 
Variable White Black oOzhez White 
RENE. 9 0 فا‎ O SES 
Marital Status ٢ ]وھ‎ A NN ES NE" 
e E Education, | Eos | Neq 5-0 n | 
Beeren len to Detail | n n Pos | DEI 
Attentiveness Scale | 8۰ Pos | n | n | 
General Science | n | Neg | nel met 
El-ersenies Scale | n n | n | Neq | 
Maintsnance Scale | now n | n d Pos | 
Erect onie IRTO: لا‎ d n Neq | Pos | 
Wczd Knowledge | RAN a POS | Myst 
AFCT Percentile | n | Pos | Neq | n | 
AFCT Group n | N= | 2-1 I | 
EM Paygrade Neq | n n | "A 
SCREEN Score | pom n | Pos | n | 
ur Er ہے ہے‎ M a Ng EN ajan nn nun Ni 2 A 
Note جح‎ 

Pcs means the coeff-Clent was positive. 

Neg means the ccefficient was negative. 

'n! means the variabie was not sélected. 


a consistent 


۲11823706 ے7 


zrend for e 
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000 8 On 


ABLE XVI 


sta Tabla XVIII, 


to be 


TE 


on this scale, 


positively 


Stepwise Regressicn for SH on Badauy 














Variatle White Black Other 
Nr m e mL CH M ale aut 
| En Ty Agor years | n | Neg | Las 
Alarcos cactus. | Pos | n | n | 
! Highest Education | Pos | Pos | Pos | 
Numerical Operations | Pos y | n f 
Anno Ne 706-5 | n n | Neg | 
ELECE SONI CE" SEA LÈ Neg n F 
| Arithmetic. Reasoning | n Neg | n | 
Comtat Scale P Pos | Pos 

| word Knowledge | Neq 0-20 | 0 
AFCT Percentile n n | Ne | 
| .ا‎ Group ! n | = | Pos | 
| Ens E Paygrade | Pos | A | n | 
| "SCREEN SCOre | Pos | no | n | 
۰ 0 2ص‎ oe a lias ا ا ر م ع ال‎ J 

Nota 

Pcs means the coeífIiCien- was positive. 

Neg means *he coefficient was negazive. 

'n' means the variable was not selected. 
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ESE all three racial groupings. Since che gooéquy and «ks 
badguy scales are both scored in the same dirsc-*icn (i.e. 
the 'good' and  'bad' ends have the same numerical values), 
this means that higher education is associated with 'non- 
bad' behaviours. Several ASVAB subtests were selected, wit 

differing signs. Entry paygrade and SCREEN score 

positive. 


TABLE XIX 
Stepwise Regression for PN on Badguy 
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COSMOS SNODDYS 


313m ip i331 25329 


| 

BE 

MW SHE 

| AFCT Fercentile 
۲ھ‎ 6۳۴ 
Entry Paygrade 

| SCREEN Score 


| ۱ MALE FEMALE 
Variable Malice" Black "Other Anis 
ER c MN a TEN aS Ze 
| Entry Age; years Neg | n n | 
Hi hest Educa ticn n | Pos PCS | 
Attention to Deta-l n Neg | 
Auto. Information Do EE n | 
Space Psrcevticn n Pos | 
Flectron:c: Intro. P n n | 
thmetic Reascning n Neg | 
| 
| 


La Er tn i eim Gb > m coo ہج‎ m di Ram euumr — رر‎ fe 


UN ضا‎ 


a 
[e a ee eee 
Io 





| 
Hiz » 
42 O 
=, 
ip 


Derenderts (number) Neg | 
te 
Pcs means the coe eront Was DES1T Ve, 
Neg means the coefficient was negative. 
tn! means the variable was not selected. 


For ENS, see Tabie XIX, entry age entered 
the regression cnly for blacks, and it has a negative 
Exerficient. Education level is selected for two grcups, 
the !other' male race category and white women, and for 
Been, the sign is positive: higher education level inmrlies 
fewer undesirable behaviours. There are a variety of ASVAB 
Subtests selected with differing signs, aa Ma ice 
Wing tc note that fer three of the four groups the number 
of dependents entered the regression. For white males 
having mcre dependents suggest fewer negative behavicurs, 
while for the 'otner' races and white femaies, having mere 


dependents is associated with more negative behaviours. 
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TABLE XX 
Stepwise Regression for AT on Badguy 








| | MALE FEMALE 
Variable White Black Other White 
e ka 28 — = 
[ Entry Age: years | POS | n | n Dez n 
{ نے‎ Status | Neg | n | n | Pes | 
Highest Education POS | چا‎ n | E 
Auc. Unrorma4t:en n | Pos | Neg | n | 
Electronics Scale n n n Neg 
| Math. Knowledde | n | Neg | Dos | n | 
Electronic Infc. n | n | Neg f n | 
| Arithmetic Reascning | n | Pos | n | n | 
| Comtat Scale n | و‎ "۱٦ Bp. Y Pcs 
I AFCI Percentile ۱ an Pos | nod n | 
AKUT Group ۱ Neg | Neg | ns s n { 
| Entry Faygrade | Neg | Neg | n | Neg | 
SCREEN SCOTS Fos | n PCS 7 
| Derendents (nunter) | n | n | 0 Si 70 
ا‎ a Ellos و < ا‎ 
Note 


Pcs means the coeffiCien- was posi-ive. 
Neg means the coefficient: was 22qative. 
TUNG an SAT he variablas sas not selected. 


The final stepwise table, Table XX, shows 
the selected predictcrs for AT groupings cn the badguy 
scale. The most consistent subtest finding across aroutings 
is the entry paygrade, which has a negative sign. THLE 
variable is selected in three groupings and implies that the 
higher the entry pay grade the mora likely ara negative type 
behaviours. 


a > 


Shown in the naxt seri of tables ars dcuble 
eross-validition coefficients by nac ago grouping and 
randomly selected sample. They are based cn forming pred- 


o: equations frcm “he stepwise procedures for sach 
padi vidual group. Validities for the "men ali" category 
were thea result cf fcrming regresssion equations on eli pred- 
ictors which had been independently selected by male race 
۰۰00 ۴109. The average validities given wer calculated 
using Fisher's transformaticns for determining average 
weigthed correlation coefficients (sea McNemar, 1263, 7255, 
139-140). 
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a. Length of Service 


he lengen Of service validities by individual 

















sample are shown in Table XXI. 2.۳٠237160۳ ۴ 2ب6‎ CANS 
rent cr the 'other' male race grouping, in both the PN 
and AT ratinas, and the women in the AT rating. Most of the 
validities are greater than .20, but only one (AT blacks r 
Sample 1) is in excess of .40. 
TABLE XXI 
Length of Service Validities by Rating and Sample 
] Sample 1 | Sampla 2 | 
RATING] aa Do en Et pe 
ا ا‎ ti. 
MEN All OIG 2748. $$0001 | 1022 2896. OOO | 
| A ASS DONA 0635 52330. “¿0001 | 
ICC ao a 00011۳۰۰ 296 2581 - 0001 
| Cther { SHE e 10533,0039] ہ۶ "۱ھ‎ MT 
رہ‎ eee nn oh 
IMEN AA gI? 2131 0001 | ھ7‎ USO | 
White 606۳ 760۰٦ 0001٦ 629 „2836 00807 j 
| Blacki 3358152550299 2000101 | 125 29630008 | 
Czher 66 .0546 .6634 | Wb ZIÉ 273999 1 
WOMEN White 2001 972050: 20013 29398 5222999 0001 | 
EN ا ہر کہ ہے ا تج‎ 
| All | 1824, 2722590 9001 | 17/93 72803 ۹ ٦ 
White| 1675 .2617 .0001 16728 1.2896 «0001 1 
Elack | SET 3389227 2.0007. l de! 39938 ٦ 
| Other | SON 303 20705 | 20. 20922 130081 
BONEN Whatest 124 .1219 ..1771 qo. 2999) 009551 
mme e anm la n anan a e E N eee 
4٠٠٠ہ‎ ہ١ا0‎ 73 8 
For sach rating as shown in Table XXII, seme of 


Be validities by grcups are statisticaliy insignificant. 


p 


The overall magnitude of these validi-ies, compared to 


iD 


ne 
mor the length of service criterion, are smaller. Th 
Maximum validity is .378, while a number of them are less 
pen .10. 


72 





TABLE XXII 
Gcodquy Validities by Rating and Sample 
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Badguy Validities by Rating and Sanpl 
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En PWE 0117 Criterion 


Pore hris Criterion; Yaliditiz2s seəm co be higher 
Hen for the good guy criterion, as shown in Table XXIII. 
Endy fcur of the 28 sample validities are insignificant at 
the .01 level of significance. The highest validity of any 
presented sc far (.4464) occurs for one of the other! race 


samples (for ATS). 


Using the Fisher method, averag2 validities were 
calculated from the validities just presented and these are 
shown in the next twc tables. Table XXIV, shows the average 


TABLE XXIV 
Average Validities by Group and Criterion 


CRITERION 


E RATING EE. | Goodguy | Badguy | 
| SH | | 





























| | 

IMEN All | 27 | A | . 1879 | 
ite | ND T | "8ت 6 لس‎ | 

| Black | .2959 | .1441 | 411956 | 
| Ctner| 3327 | 3/87 | . 340 i 
E co | .. | Benz 
p ALI | 22751 | 20793 | 20:294 | 
White . 2888 | loo. | 5312 | 

| Black CAI | . 1412 | «2500 | 
ther OES | 2056 2 | -1354 | 

WOMEN White $2502 | -1775 200055 
EA c, 71 
I^ All {f . 2666 | .1380 | .2148 | 
White | 27 | 206102 | $2501 | 

Elack | .3801 oo | SE | 

her | 22762 .3002 20097 | 

WOMEN White . 1796 | 9252 | . 2549 |‏ 
نے = کات 20 ,سے 











validity across each of the samples by racial groupings and 
ratings. Ihe largest average validity occurs for the AT 
mating (.41) intere. "othez' recial greup on the bad guy 
Etitericn. The seccnd hiahest validity is also for an AT 


Being (2238); 1t is for she black racial g-ouob. 


74 





Ecce VO IISES Grand) average walidities for men, 











SST rating by criterion. Forzlengen of service; at! three 
rating average validities zerinssexceesior 25," With a 
EN chtly increasing trend in size of coefficent as the 
TABLE XXV 
Validities fcr Males by Rating and Criterion 
CRITERION 
a ls N A En 
E RATING { ICS | Goodguy | Badguy | 
————— ——— ———— —— — — — —— e -o کے سے‎ —————— 

L SH Hi 82515 | .2046 32287 | 

E EN 22707 1502 157 uot 

| AT : . 2762 | .0867 | 2050 | 

A aw n a -aanntansataann Eni o e de) 
rating ccmplexity increases. For the goodquy scale, the 
tank cráer of validities by magnitude is reversed: validi- 


ties decrease with rating complexity. The averace ve 
moments Ch this criterion is varticularly smail. Thers i 
Bemeensisten* ranking by complexity for the other criteticn, 
badguy. The PNs validity remains about the same as fo h 
Man guy scale, as does tne SH validity. The average validity 
for the ATs on this scale has increased considerably, up to 
E245. 


Ce ESTIMATING CUT-OFFS 


ine method for estinating the cut-offs was described in 
E 


u 
the previous chapter. However, to illustrate the method, the 
EN ulaticn cf the first few values in Figure 5.1 is given 
Meme. It should be noted that most of the figures in this 
secticn have two or mere graphs drawn on them. This is done 
a 


O 
in the interests of economy rather th 
a 


17 
(D 


lated: each graph is based on 


0 
Fl 


Eero telaticashlc?. 
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The figures give several pieces of information, “he mo 
h 


E 
Mwen the Fase rates, for various potential predictor cuttin 
a 


(n 
+ 


important of which is the line repesenting percentage 


TA 
oe 


0 


Be 
“n 


M a 


Ecores. For Figure 5.1, the base rate is determined 
follcws. Of the 2,020 male SH personnel 1,235 served four 
years or more, while 785 served for less than four years. 
Converting these values tc probabilities gives a 61.145 
ehance fcr a male SH meeting the crizerion of completing 
four years or more years Of service, and 38.86% chence of 
emning 13. Using the utility values given in Table IV and 
equation 4.1 we now calculate the base rate as the sum of 
the products of the chances of an outcome by its utility. 
The SH length of service base rate is 6,693.39. As the 
a 


reader will recall, this is the lua for selection set so 
low that all personnel are accepted. Mies Tirst DESEN ial 
cut-ing score is the smalles predic orn score zon he 


Eae ot 2020. This score is 34.1208 and occurs fer an SH 
who passed the fcur year criterion. ich the cutting =ccrs 
set at this value, thers are 1,234 sailors out of 2,9 W 
are successful and who would be correctiy redicze 
successful bassd on this predictive 2lationship. 0 
sailcr cut cf 2,020 wculd have been رج‎ a to have failed 


Bs critericn for this cut-off, while 735 wculd have bsen 


He 
< 
iD 
113 
ct 
D 
a 
(t 
O 


incorrectly predicted to pass. The numbers are co 
puobabilities to give 61.09%, .J5% and 38.86%, respectively. 
These thret probabilities have utility values of 19,260, 


E50 and -13077. Summing across the produc-s of probabili- 


pos and utilities gives a total values A 
Thererore, the return over base tate for a cut-off at 
34.1208 is a -0.21% chanae. There is a slighily negative 


ESctUTLT Over Se rate fcr this cutting score. On Figure 5.1 
the Values 34.01208 and -0.21 ars plotted as the first 
N. CEE point and its respective return. The next highest 


predicter sccre, 34.4115, is choosen. This happens to be for 
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sale: who fails to meet the criterion. i.c 7 ۷٥ 

Wara Of 34.4415, the probabilities and their resp 

Metlities are: 61.09% and 19,260; .05% and -9360; US and 
£ 


13077; and, 38.81% and -13077. Summimg the product of these 
pues gives a total utility of 6685.70, which is a -.11% 


decline cver base rate. Therefore the next point plotted is 
50,4 155 and -.11. This process is repaated for ail 2020 
predictor scores keeping track of the value of “he maximum 
return over base rate and its tespective cutting score. 


Serurn Which are 


(L 


Note in Figure 5.1 that values of base rat 
Mess than -20.0% are not plotted. 

Also shown in the figures are two othe 
maticn. The selection ratio is defined a 
P=G@POrtTLON cf personnel selected out of thse tor 
The values shown ir the figures are selectio 
cutting score which maximise total recturn ove-z base rate. Or 
each figure selscticn ratio is shown either by race (for 


nen) or rating (for women). The other staciecdo “Lerche 


mn 


es crich proportions for those who are predicted tc be 
successful. For Length of Servica, the percentages who 
serve for at least four years are given, while for «ths cther 
criteria the percentages by criterion categories are shown. 

cted 


expe 
performance of the grcup selected for this cutting scor 


H 


Xt 


0 


his latter statistic gives an idea as to the 


While the selection ratio indicates how the selection device 


EE impact the applicant group at: this score. 


As Can be seen from Figure 5.1, the optimum cu-t-cff 
score for the SH rating prcduces almost a 5$ incrzsess over 
the base rate utility. The mored c or equation here is fòt 
tale SHs based cn all those variables selected for men in 
Table XII. Tha Figure shows the selection ratios and 


success rercentages fcr the optimum cut-off score ty zace. 
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qu 
- 


Mee chis cut-cf£f, white SHs have the smallest selectic: 


- 


T 


¡y 
pa 
in O 


of any race, but they also have the smallest percenta 


LO 
(D 
ci 
tH © 
(D 


success fcr those who would be selscted. The majority of 


(b 
t 
(D 


'hlack' anä "other! racial groups are selected and 
highest percentages are successful in these groups. 

Shown in Figure 5.2 are the cutting scores derived 
for race specific predictor equations. The best expected 
return is fcr the 'other' group (28.83), followed by whites 
eon), and blacks (1.75). Set at these respective cut-off 
levels, 85% of the ‘cther' group are selected with about 76% 
cf them serving beyond four years. For whites, 95% would he 
selected, with 59% successful. EOE DIELS, Vvoruelly ail 
(99.5%) wculd be selected, with a 67% success rate. 

In comparing these figures. for. SH on LOS (Figur 


B 
and 5.2), several trends are apparent. The 'racsa-biind' 


w 


selecticn seems to be most severe, in terms of selection 
Maric, Ch the white group. Wher the white specifi 

equation is emolcyed, more whites are selec 
decline (about 1.5%) in the percentage suc 
MOEK arcup, a race specific predictor als 
EEXECCt1Oon ratio, with a slight decline in th 
Beyer for the 'other"' race group, he 
ictor equation markedly reduces the sel 
about 13%), but boosts the success perc 
same amcunt. 


Prgurss1 5,3 and 5:24 show “LOS results for the PN 


Sting. Race blind selection produces abour a 5% improve- 
menz cver base raze. AGEDODeSHSs.cC tue race oblinad. Drèd ctor 
is most severe on the white group in terms o selection 


f 
ratic. Hcwever, for those whites selected, their s 
percentage is better than the black PNs. While ck 
are “he least successful ror this predictor equation, about 
97% cf them are selected. At the cut-off level for this zac 
blind equation, 100% of the ‘other' racial group is 


selected, with about 76% of them being successful 
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efron ro: sendcwsdual tace sSelsction egua:lcns 
(Figure 5.4) is greater than from the race blind selscrion 
for each race. Blacks show the biggest improvement, with a 
eduction in their selecticn rate, down from 97%, but an 
imprcvemert in their success percentage. Next come whites 
whose selection ratio has also been reduced but their 
success percentage improved. This is followed by the "other! 
racial grcur, who are now selected at a rates of abcut 94%, 
with a slight increase in overall success percentage. 
Mme retore, for all tacial groups, race specific predictcrs 
have lead toa decline in selection rate, but improvements 
Bieovercall utility and success percentages. 

As can ke seen in Figures 5.5 and 5.6, the same 
trends are n < ua EOC ATS. LOS, Race hilındzselser-cen, 
Mad tc about a 3% improvement on base rate, with all races 
being fairly close tcgether on selection ratios and success 
Fercentaces. The white race is marginally ahead cn both of 
these indices. In Figure 5.6, about the same values apriy 
for whites cn race specific selection. However, the race 
specific equations for blacks and for the 'othert racial 
woup have determined optimum cutting scores for which all 

d 


of the cases wouid be rejected. That is, no one is selecte 


and thus no one is successful. This result may have been 
expected for AT 'c*thers' because of the insignificant 
۲۰۰٠ ٢۲٠١٣ ہ٥‎ ۶٤ذ‎ 1٥0 fcr this group (see Table XXI). Low 
validity suggests that any optimum cut-off value is likely 
Ferse Spuricus rather then meaningful. However, Table XXI 
Pws a highly significant validity for blacks. Thersfcre 
Ecco vong an optimum cut-off whic rejects =veryon= is 
cartainly net expected. 

Shomm in Figure 5.7 are the LOS results for white 
women ENs and ATs. Eoth optimum cut-ofís have imprcved the 
kase rate figure (24% for PN and 36% for AT). While thas 


selection ratios are lower than their male counterparts, so 
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O 


Eoo are their success percentages. This is nor S 


iD 


surprising, Since Tables X and XI show women have th 


smallest average LOS of all groups in these ratings. 
Popo cc ody (Cz TEE ron 


SOUND Figures 5,8 2005.19, care the results of the 


analyses on this criterior. 


rE ENE SH rating, Tacs Dlind (selection Leads =o a 
election ratio for whites that is ths smallest of al] three 
races. Hcwever, as can be seen from Figure 5.8, «he optimum 
Cut-off yeilds a return of just over 2%. Pon raco spacific 
eee ticn (se Figure 5.9), the returns for whites and 
“other! races are well over 30%, but in this case, cnly 65% 
of the white group wculd be selected. The selecticn ratios 
are reduced for ail races, compared with race bilind 
selecticn. 

The returns for the PN rating cn the goodguy scaie, 
follcw a similar pattern as can be seen fron Figurss 5.10 
2315.11. However, EOE this Gating, ط:‎ 136 ا٤ج‎ in. che =ace 


blind selection, have the smallest selsction ratio, but they 
also show the largest rerurn (42%. Indeed, racs specific 
BS Se cion has Improved <=helr position in selecticn Tatio 

Be icon “he icwest for race biind selection to the mid- 


nt on race specific selection. 


yi 


po 

For ATS on *=hk2 goodguy scale, race blind selection 
does not produce any positive return over base zate (see 
Ue 5.12). The retuen for race specific selection (Figure 
ps), is substantial for blacks and ‘others! (38% ani 782%, 
Bespectively) but a little more than 1% for whites. For the 


Berner! race grcup, this high ‘return is achieved witha 


EMec*tion rate Of akcut 61%. For female PN and AT on the 
goodguy criterior, see Figure 5.14, the returns are almcst 
600%. The cut-cff fcr AT seems unrealistic, since only 14% 


are selected, whersas for PN the selection rate is 75% means 


that a reéescnable prepertion will be selected. 
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3. Fadquy, Criteric 


a 


t 
O 
1 


Ihe seven Figures 5.15 tc 5.21, show the rasul 
Mis critericn. 

Race blind selection for male SHs, see Figure 5.15, 
shows abcut a 3% imprcvement over base rate. Whit n 
the race which have the lowest selectio 
selection. Moderate improvement for w 
Beetal grcup occur for face specifi 
lo). 

For PN, see Figures 5.17 and 5.18, there is vi-tu- 


BEY no effective return using the badguy criterion. While 
m 


the 'cthert racial group shows only about a 6% improvement 
over base rats, tha selection ratio of 98.2% is extremely 
negh. 

As c 


an be seen in Figures 5.19 and 5.20, for AT men 
no selection device has been found that produces an improve- 


ment cver the base rate, 


Mero women) sO tues Cri erion, Figura 5.21 shows a 
positive (AT) and a negative (PN) return. The AT return is 


macul tc interprete and results ina 99%. selection 


Getic. 
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Figure 5.21 





VI. DISCUSSION 


fee Chapter is divided into two sections. The first 
deals with the results in relation to the research 
hypotheses. The seccnd discusses other findings. 
A. RESEARCH HYPOTHESES 

The stepwise regressions, particularly Of “the: LOS 


Mwe Erion, tend to support the firs- hypothesis which pred- 
icted that entry age, education level. and ability tests 
would be significant predictors of performance. 206 ad: 
was not selected for every regression, put it proved t 
Significant for at least one of :he race/sex  grouri 
Mes cr each rating. The relationship betw:zen age and the 
criterion was always positive: longer service is indicated 
for greater age at entry. Educational l=vel was cften 
selected toc. However the direczion of the relationstir was 
Bek as ccensisten“. Fcr soms groups it was positive end Tor 
Somers negative. There seems to be a trend for the costfic- 
Eu for education level to be positi 
ratings and negative in the higher comp 
BENndgsng cculid be a related =o restrict 
which were noted in the literature re 
the  ASVAE scores  entersd every st 
Signs were not consistently positive or negative. 

me least Tor one Bec en Ot) palms © LOS, 67720824٦٦ 
coefficients when averaged across groups, show a trend to 
Encrease with ch ecmplexity, a relationship predicted by 
the second hypothesis. On the whole, the validity coeffic~ 
lents are large enough to suggest that the predictcr equa- 


f=) aze Surticirently powerful to improve selection on 
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these three criteria. Gemparärg Criteria, LOS has the 


Highest validity. 


BE. OTHER FINDINGS 


The descriptive results yeilded several general fird- 
ings. They seem to support che view that whites have supe- 
rior perfcrmances on psychometric tests of ability. On aa 
Sethe ASVAB subtests, with one or two exceptions, the whites 
oup in each rating has performed better, in ter 
score, means than tke other two race groups. O 
mea, this race, ¿cr sach rating, is younger at entry and 
(perhaps therefore has the lowest educational level, with 
the smallest proportion being married variables which might 
ke expected to be asscciated with lower ASVAB scores. For 
the SH and PN ratings, the white group has a shorter LOS, 
ET vith the highest croportions of in-service  'gcod' and 
‘bad' behaviours.  Fcr the AT rating, blacks and whites have 
about “¿he same LOS (blacks serve slightly longer), and 
whites aze more likely to have positive goodguy perfor- 


mances. The white wemen have similar performances as whit 


iD 


ct 


men on beth the predictor and criterion variables, excep 


that they have the shortest LOS and generally exhibit ti 


D 


smallest percentage cf 'bad' behaviours. 

The estimation cf cut-offs, Com all ceri erla, has 
supported the noticn that the significant relationship 
between predictors and criteria can be useful in a selection 
setting. As measured against the concept of base rate, many 
groupings within ratings can be better selected. 

The findings of this ceseach support the currents US Navy 
selection procedures. For every stepwise regression la which 
it was selected, the SCREEN score (which is derived directly 
from the current procedures) was always positively reiated 


em he Criterion. 
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From the averaged validities it appeared that tha LỌ 
predictors provide a means of increasing “he selection 
Mrility across most trade, race and sex groupings. Ho E 
when Optimum cut-offs were derived it was apparent «ha 
virtually none of the AT relationships would yield any 
reasonable utility improvement over the base rate. For the 
Eher ratings it appears that, except for SH blacks, tnere 
aze pcsitive returns to be obtained through selection based 
Sn Che identified predicter/critericn relationships. The 
highest returns are for PN and AT women. This is despite 
the fact that some predictor equations had validities which 
were small, and in some cases statistically in n 

(e.g. FN 'cther* and AT women). Apparently, althcugh the 
uU dity ccefficient was insignificant the relationship was 
EN S=rong enough toe yeild a cutting score which improved 
overall utility. 

e CNET tso sctaperila, although they did rot have 
double cross-validiticn coefficients which were as large a 
Heme LCS across groupings of personnel, also apparently 
oredictabkle from pre-entry information. However, when the 
eu Offs were determined, the qoodguy critericn appeared to 
.ےگ‎ potential for improving selection in all greufiags, 
withthe exception of AT white women. For only three group- 
meas On the badguy critericn was a cut-off found which 
returned ketter “han 5% over base rats. Ina real sense 
these seem more useful criteria than LOS, since they appear 
to capture more relevant information relating product and/or 
cost. The extent that personnel are promoted during a vericä 
of service and “he extent to which costly negative behav- 
Wn Ss can be avoid are Significant contributers to the crga- 
nisaticns overall effectiveness. It would appear that the 
decision centered validitv approach has revealed a number of 
potentially useful relationships which may be used foc 


better selection. 
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nuces pid Sselscesgeu cut-ofts provided scms inter- 
EL UG Lindinras. FOr the SH rating Zn  par-icula- It seems 
clear that the white race would have greater proportions 
EE ected than ths other to racial groups if the race-Elind 
prediction device was ussd. However, as hes already been 
menticned, mcre of the white SH personnel should be rejected 
Since they exhibit pcorer criterion performances than the 
cher! zaces. FOr ne -PN' ratz2ng, racs blind selection 2ls0 
selects the smallest percentage of whites. This is a mcze 
r CUS result since fcr both ratings, most o: the personnel 


were white and one wculd exrecz that they would domi 


Ih 
£t 
ci 
(0 
cl 
ور سک‎ 
iD 


zegressicns to the extent that greater proportions of 
would be selected than would the other races. EOD 2 
Seeciftic selection the white selection ratio atz the optin 
Met se ne longer the lowest for the LOS, but it is f 
"he goodcuy scale. It appears that whites do not perform 
well as the other races in these ratings (PN and SH). 

The decision centered validity approach has turned out 


to be a powerful tool for the present ressacch. It has 
se n 


allowed a means of directly damonstrating the usefulness of 
EHESOmposite predictor in a future selection role. Provided 
wp Orr ata utility values can be derived, it is obvicus 
that the methodology employed in this study could te trca- 


Hened. For exampie, in evaluating which cut-off tc apply, 
the critericn can be segmented into as many Separate catego- 
Eccc as 1s required to reflect the different individual 
u nS fcr the pairs of predictor outcomes. At one extrene 
in criterion categorisation is the LOS methodology employed 
kere, ir which the criterion was considered as a dichotomy. 
NIH ne other is the Situation in which sach and ever 

subject in the research could be individually evaluated in 
utility terms. For example, for every subject a value could 
be placed on the service he/she provided, and an estimation 


could be made as to the value zo the Navy (positive or 
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Megative) in the cese that this p 
because cf selection screening. These two values 
would prctatly not be the same, could be taken as predictor 
Wae api” and predicter reject utilities and then use 
exactly the same manner as in this study co determine a 
optimum predictor cutting-score which maximises tota 
lity for all subjects, If the utility values were accu- 
mately derived from costs and products, chen it may be 
possible tc express selection Berl y Rn. dollars par 
enlistee, which would be a readily acceptable means cf just- 
ifying a selection prccedure. 

In applying the regression ¢guations developed 
an actual setting, there ars two other important considera- 
tions. These are both related “to decisions that the Navy 
would make with respect zo implementation. In this thesis, 
there was no external Navy decision as to which criteria of 
performance is the most useful for perscnnel s2lection. 
Length of service is widely used as a measure of 
desirabise behavicur, but for sone m On 12 may not be 
so important. Indeed for some employments, sho 
may even be a goal 2.9. those enmplcymen<s whi 
EBrinar:iiy tc prepara personnel for later jobs). 5 
any attempt is made to implement these resuits the crit O 
would need to be specifically defined. zmeeuld “Be chan 
there are cther more pertinent cr m 
in this thesis. 

The cther issue about implementation is related to costs 
and has two aspects. First, the presen- study estima ted 
Costs and utilities through published cos* data. These 
We MITES Were clearly and directly  reievan- for the LOS 
Exc c ericn, but even in this application PE were 
malik” as zo the relative value oc the predictor/criterio 
outcomes. There are, perhaps, better accounting or economic 

A 


procedures to estimate these values than was used here. 
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evalvaticr cf the utilities employed here is needs 


d 
impiementation of these selection devices. Second, zhe czher 


Epect ci cost as directly related to implementation. In 
بد تشاک‎ ٣ جج‎ Optimum curtting-scoze on the sredictive 


device fcr this study and expressing this as a percentage 
a 


return over base rate, it is clear that ic does not take 
into account any costs associated with implementation. A 
ccst-Lbenefit type of analysis wouid be necessary to weight 
up the total costs of implementing and maintaining the 
procedures, against the expected return in terms of more 
profitable selection. The data presented har2 are relevant 
ES ThiS type Of analysis, but returns over base tate, for 
example, would need to directly <ak2 account of che numbers 
upon which each of the graphs in the previous chapter was 
based on. Sens of the very high returns over base raze may 
be seen ina different lign: when the numbers of casés is 
Salen into account. Ease rate is a utility per enlistee: if 
the applicant pool is small, comar utrie y (na produer o. 
the number of enlistees by utility per enlistees) 0 3 NOU 
be sc hign. If the cost of implementing and maintaining a 
procedure was very high, then the expected return over base 
tate would have to be even higher, so as to produce a posi- 
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VII. SUMMARY AND CONCLUSION 
This thesis set out to develop selection standards for 
three US Navy ratings which varied in terms cf their 
complexity requirements. The selection litesature was 
extensively reviewed. This gave direction as to the varia- 
Pees likely te be predictive cf دوہ و‎ performance as 


well as scme guidlines for choosing appropriate 


t1 Q 
ti 
po 
+ 
ip 
iy 
pa 
w 
ci 
0 


The method of svaluating the ER‏ 31 60ت ت8 
casting subsequent performances took two forums. The first‏ 
was the traditional method for estimating validity coeff‏ 
Memes -hrcugh double cross-validation. The seconä apr‏ 
estimtes to varicus predicior/cii:zerion outcomes s‏ ج٢۲۰‏ 
as to determine the cut-off score an the composirs pr‏ 
which maximised overall utility. These analyses were de‏ 
Ee ccilling for che effects cf such moderator vari‏ 
job ccmplexity, race and sex.‏ 

Nenn each rating a number of useful 
critericr rslationshirps have been found. These rel 


maximissd +otal It Ol the selsctich dəyil 


E 
a h 
were shown to be valid and cutting scores derived which 
u € Som 
results suggest a siqrifican= race component in per 
This finding suggests the white race does not perf 
well as the cther races in the SH and PN rating. The signs 
cn scre ASVAB coefficients indicate negative rel 
ETS CLAterion scores. This result was nor expects 
E20: 


Mis research has illustrated the relat: 
h 


exists in the data and the use to which they could be put 
for selection purposes. Implementation of any cf these 
relationships as a selection tool requires a confirmation 


that the criteria used here are relevant and useful <to 


personnel managers in the US Navy. In addition, the current 
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analysis has been performed withou- any consideraticn of che 
possible costs of the introduction and maintenance of the 
selecticn procedure. It would be necessary to conduct a 
cost benefit analysis to determine if the total expected 
returns from implementation were sufficient to compensate 
for the costs involved and therefore to produce a positive 
total return. To dc this properly requires Navy decisions 
the appropriateness of “he criteria to be predicted 
ade the utility and disutility values to be assigned to 
= C 


3 
amdwncorsrcctiNprsdasctcr/er2vc9snroa clessifi 


Correc arions. 
Such a een attempted here, 


Sostiene tama ly sis has bD 


but is relevant for future research. 
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À 
EXAMPLE PROGRAM LIST 


PENDIX À 


2 
INGS BASED ON PROCESSING SH 


This appendix gives sample listings for ths programs 
used to analysise the SH rating. These exactly parallel 


analyses for the other retings. 


1. SAS Program tc Select SH from NES Conos“ Data 
Cn the following pages (Tabie XXVI) is a listing of 
ED cb to Select “out th] SH from the Cohor- File of 


206,000 and to place their records on Mass Storage. 


TES variables are read ia from caw Oa tan he 


D 


first two pages of Table XXVI, show the variables locations 
pee heir descriptions. This lists all the variabies avai- 
lable in the cohcrt even though only a smaal number of them 


were actually used fcr the present analysis. 


Mie reader fe coterred co the SAS "Ussr's Guide" zos 
an explanation of the procedures  involvsd. Ccmmenis 
Boughcecgt the listing explain some of the program steps. 


2. SAS Proqranm tc Perform Rsagressio 


Ca CORR ہجو ںو ےسک سے ھی چ‎ Ce > Y A وہ‎ at ee 





LA 


Phe tollowing two tablas give lissings 62 two SA 


f» 


programs. 


The first (Table XXVII) Loe tae “onè né. pe ro-a 
stepwise regression cn the whole set of predictors sc as to 
select out those which the more useful. The reader will ncte 
that after the SH data is read in, i aS Soried by Tace 
which facilitates the subsequent regressions which are 


performed by race. 
The second (Table XXVIII) u 


ses the output from the 
previous analyses to construc: regression models fcr rele- 


vent race/sex groupirgs. The data is split, *or sach 
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grouping, into two randon samples used as he basis for 
cross-validation. EEC CEO ala CLI SIC, Scores, after 
gali dation are «chen output, in raw data form, t mass 


0 
storage sc as to be available for later FORTRAN analvsis in 
estimating cut-offs. 


7-۰۲۱۶۶۶۸۰۰۹۲۶ ۶ ۵ 3۶۰۷۰ 1663555 ۴388۴5-080 22-28 
Predictors 


Ibe za 0٦ہ‎ 0٠م‎ 26910666 in the preceding SAS run is 
used as input data for this program (Table XXIX)  alcng with 
Ens arpzepriate utility values. 

The program is written so as to be run on one of the 
Navy Postgraduate School's terminals which is linked toa 
EE >0 3366 PlLOteer, altnough I could easily be rewritten 
Æt a different plotting device. ThE DISE. AG Ís pez rer ned 


using sutroutines of the School's DISSPLA computer package. 
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Program Listing of FORTRAN Program for Cut-offs 
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APPENDIX B 
STEPWISE REGRESSION RESULTS FOR RATINGS 


This appendix gives the results of the stepwise 
regressions. They are presented in the form cf rating 
specific tables. As these tables were constructed directly 


from computsr output the variables all have the SAS names 


that were used in the analysis. Therefore, interested 
aa er ara directed zo thae relevant sections of the 


preceding SAS program listings to determine exactly which 
variables are listed. In all cases the variables and their 
Wal NG en SLONS  Ccrrespond to the tables in the bedy of 


the thesis which lists the stepwise regression results. 
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TABLE XIX 
All SH Stepwise Regression Results 
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TABLE XXXI 
All PN Stepwise Regression Results 
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